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PREFACE 



The survey reported here was undertaken by the ERIC Clearinghouse 
for Social Studies/Social Science Education (ERIC/ChESS) in the fall of 
1973 to get a picture of how social studies is being treated within tho 
broad context of activities loosely labelled "accountability." While the 
study was originally designed to focus on the status of social studies 
in the accountability movement, the information obtained from our nation- 
wide survey of state departments of education revealed social studies 
activity in accountability to be quite limited. Therefore, in this re- 
port we discuss the social studies accountability activities that were 
disclosed by our survey, but we also include findings on general ac- 
countability systems and, in fact, these findings comprise a siibstan- 
'tial portion of the data analysis. 

Organization and Content of the Report 

The basic data gathered in the survey are briefly condensed in a 
summary preceding the report. The report itself begins with a general 
introduction to the accountability movement (Section 1.0) , followed by 
an accountability model which the authors 'suggest as a framework for 
analyzing, state activities (Section 2.0). The model is a general educa- 
tional accountability model, but it can be applied to social studies 
by incorporating social studies goals and objectives into the model. The 
purposes and methodology of the study are described -in Section 3.0; and 
Section 4.0' presents the study results in detail. 

Appendix A lists the individuals in the state agencies who supplied 
information for the study and those persons who participated in a small 
conference in Boulder to check out preliminary results. It also presents 
the survey questionnaires and the charts which were used to verify the 
original interview data. 

Appendix B reproduces two very thoughtful background papers on ac- 
countability, written for this study by Robert Trezise, social studies 
specialist for Michigan, and Michael Hartoonian, social studies special- 
ist for Wisconsin, 

Appendix C provides in tabular form^ by states, much of the basic 
data on which this report is based— -and more. 

iii 

8uii00007 



Appendix D presents a selective annotated bibliography of documents 
related to accountability published by 37 states. 



Some Practical G^Jiidelines for State Departirv:?nt of Education Personnel 
Engaged in Accountability Activities 

Since, in our view, the point of all educational research is ultimate- 
ly to iit^rove practice, we think it appropriate here to make some practical 
suggestions based on our findings in regard to accountability. This study 
shows that a wide variety of terminology, activities, cind viewpoints eaists 
among the states in the realm which we have designated "accountability" 
or "accountability-related" activities. Is it possible to draw from the 
survey data any words of wisdom that might aid persons in state depart- 
ments of education, particularly those concerned with social studies, to 
plan and conduct their accountability activities efficiently and effective- 
ly? The authors, though fully aware of the controversies and disparate 
viewpoints about accountability and of the inadequacy of their survey data, 
suggest the following guidelines as a beginning. 

1. Plan ahead (to quote a well-known slogan) . Account£Q>ility acti- 
vities are often undertaken on an ad hoc basis, in response to immediate 
pressures or opportunities. As with any important activity, good planning 
by a group that is representative of the most important interests, but 
still not too large in number, is essential. 

2. An image of what the essential parts of an accountability program 
are and how they are related l:o each other should bu sketched out as early 
as possible, subject to later revision. This is what we have called a 
"model" in this report; but the image need not be put into a diagram nor 
need it be called a model, if this approach is not compatible with the 
planners . 

3. Other states have had a great variety of experiences with accounta- 
bility; use it. This report describes much of the experience of other 
states. Details of the survey beyond those contained in the Summary and 
the body of the report are givian in Appendix C. Other information can be 
obtained from the state publications, many of which are listed and des- 
cribed briefly in Appendix D. Two narrative reports of accountability 
viewpoints and activities are given in Appendix B. 

iv 

ERIC 



4. Fose as meiny questions as possJ3le about the proposed or current 
accountability program; then proceed to answer as many as possible. Re- 
turn to the questions periodically to see if the answers need to be re- 
vised and if new directions or emphases are suggested by the questions. 
Some of the questions that might be posed follow: 

a) Who are all the groups or individuals who have an 
interest in the progreim? 

b) What are the appropriate roles of the various inter- 
ested parties? Which persons, are specifically responsible for 
which tasks? 

c) Referring to the adopted -model or image of accounta- 
bility, what parts should get the most emphasis? What order 
of priorities and procedures^ should be established? What parts 

' should get little attention or be eliminated from fiirther 
con s i de r ati on? 

d) Is it desirable to have legislation to guide or impel 
the program? If so, what kind of legislation? (Use the experi- 
ence of other states.) 

e) Should budgeting and funding be related to accounta- 
bility results? If so, how? How can persons responsible for 
budgeting activities and for programming activities be brought 
together in a cooperative relationship? 

Contributors to the Study 

Among the many persojis who contributed to this report, we are par- 
ticularly grateful to the 97 persons in 48 state departments of educa- 
tion who suppli.ed data by telephone interviews and by mail. We regret 
that Illinois and Tennessee did not find it possible to participate in 
the survey. We also wish to thank those who participated in the check- 
out conference in Boulder, giving some important mid-course corrections, 
to the study. 

Several former ERIC/ChESS staff members made important contribu- 
tions in the plcuining, data-gathering, and early drafting stages of the 
study. I'hey include Karen Friedman, Thomas Ward, and Joanne Binkley, 
as well as Robert Fox, who was the director of ERIC/ChESS from 1972 
until his death in March 1974. 
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SUMMARY 



The results of this study are summarized briefly in the following 
statements. There are numerous qualifications to these results, which 
will be found in the report. The data given are as of the date of the 
survey — the fall of 1973. 

1. State activities or programs that might come under the broad 
definition of accountability used in this report have a variety of names. 
The most common names are "needs assessment" and "educational assess- 
ment." (Section 4.1 and Table 1) 

2. Half a dozen or so agencies within the states are responsible 
for originating accountability activities. The most common of these is 
the state department of education. (Section 4.2 and Table 2) 

3. Seventeen states have legislation dealing with accountability 
cind two more have legislation pending. (Section 4.3 and Table 3) 

4. Accountability activities are funded by a variety of federal, 
state, and local sources. The most common source is federal funds, par- 
ticularly ESEA Title III funds. (Section 4.4 and Tables 4 and 5) 

5» The roles played by state depar^ents of education in accounta- 
bility activities are determined by a wide variety of agents, no one of 
which dominates. (Section 4.5 and Tables 6 and 7) The roles played by 
s.tate departments in accountability activities also vary widely. (Table 
8) 

6. Out of the -many steps that might be taken in an accountability 
program (Section 2.0, Figure 1) , most states have teiken only one or a 
few. The most conmon activities undertadcen have been conducting n'^edr. 
assessments and determining desired outcomes or goals. Testing of stu- 
dents is the most common form of needs assessment. (Section 4.6 and 
Tables 9, 10 and 11) 

7. At least 37 states ha\'e published documents related to their 
accountability activities. These documents, along with our survey data, 
indicate that 12 states have developed some kind of accountability model 
and nine others have some kind of long-range plans for their accounta- 
bility programs. (Section 4.7 cUid Appendix D) 

8. Forty-one states currently have some kind of student testing 
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program. The most common programs are for reading (40 states) and mathe- 
matics (33, states). Altogether^ 13 subject areas are being tested, with 
most Atates testing fewer than five subjects. (Section 4.8 and Tables 
12 and 13) 

9. Eighteen states have some type of activity in social science or 
social studies, mainly in needs assessment testing. (Section 4.9 and 
Tables 14 and 15) 

10. The reasons social studies has received relatively little atten- 
tion in accountability progrcims, according to state social studies special- 
ists, are that social studies is not a priority area (26 responses} and 
that social studies is too difficult to meausure (7 responses) . (Section 
4.9 and Table 16) 

11. While only 18 states currently have accountability-related activ- 
ities in social studies, a total of 38 states have plans either to con- 
tinue social studies work and/or to institute new activities. The planned 
activities include conducting student testing, specifying objectives, and 
developing curriculum plans. (Section 4*9 and Tables .17 and 18) 

12. Many but not iall state departments feel pressure from a number 
of sources to conduct accountability programs. About one-third of the 
states feel pressure from the legislature, about one- third feel pressure 
from a variety of other sources, while almost one-third feel no pressures 
at all. (Section 10 and Table 19)' The feeling of pressure from the legis- 
lature has little or no correlation with whether accountability legisla- 
tion has been passed. (Table 20) 

13. So far, the outcomes of accountability programs have had little 
effect on the edlocation of funds within states. Some states use assess- 
ment results to allocate funds for compensatory education programs and 
others use these results to help secure emd appropriate federal funds. 
Eleven states are considering plans to relate funds allocation to accounta- 
bility outcomes. (Section 4.11 cmd TeQ^le 21) 

14. Future responsibilities for accountability activities are seen 
by state department personnel as being about equally distributed between 
state and loccd educational personnel. (Section 4.12 and Table 22) 



ERLC 



00012 



STATE ACCOUNTABILITY ACTIVITIES AND THE SOCIAL STUDIES: 
A NATIONWIDE SURVEY, A PROPOSED GENERAL ACCOUNTABILITY 
MODEL, AND SOME GUIDELINES 

by 

Sharryl Hawke, 
Christine Ahrens, 
and 

Irving Morrissett 



ERIC 



1>0 An Introduction to Accountability 

One key to the current educational scene consists of the "3 Es" — 
efficiency, economy, and effectiveness. (Porter 1972) Consequently, 
the drive for accountability, which embraces these concepts, is strong. 
Such strength, however, does not represent consensual thinking; confu- 
sion and controversy surround the movement. 

Accountability is defined here as a process which: 

1) publicly specifies the goals and the objectives of an education- 
al program; 

2) encourages efficient use of resources in achieving the specified 
goals; 

3) measures progress towcurd those goals and objectives; 

4) shares the results of these measurements with those affected by 
or interested in the program; and 

5) uses the resulrs to make improvements in the educational program. 
(Glass 1972; Wilsey and Schroeder 1974, p. 1.) According to many theo- 
rists and practitioners, education will be improved by developing such 
carefully organized, output-oriented reporting systems. 

1.1 The Pros cmd the Cons 

Those who support the accountability movement like the changes it 
is producing. Theoreticians feel that the movement is causing people 
to question actively the goals and accomplishments of education. Admin- 
istrators feel that accountability is causing a rethinking of the entire 
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education process and is therefore leading to productive innovation and 
changv that promise revitalization. Citizens thin : that the current move- 
ment is filling the long-existent gap in the public's right to know how 
money is spent and the outcomes of the expenditures. Teachers say that 
accountability provides the opportunity for •;;idc-rangc participation in 
formulating the goals and directions of the educational process; numerous 
individuals are, therefore, forced to assume responsibility for education- 
al outcomes, state department personnel are challenged by the opportunity 
to offer new kinds of educational leadership. Legislators think that 
accountability is properly shifting the focus of education from input to 
output. 

On the other hand, the accountability movement has also generated 
dissatisfaction. Theoreticians note that the statistical basis of many 
.accountability programs causes planners and educators to underemphasize 
the affective and humanistic aspects of the educational process. Adminis- 
trators claim that accountability forces them into the role of scapegoat. 
Citizens, in expressing their confxision about who is doing what to whom 
and why, conplain that their views and wishes have not been taken into ac- 
count. Teachers feel that the new drive infringes on their professional 
role. State department personnel say that the cvurrent bureaucratic struc- 
ture and staff size prevent them from efficiently responding to new re- 
sponsibilities. Legislators e3q?ress discontent about decision making 
that is based on limited knowledge and dubious statistics. 
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1.2 Accountability in the '70s 

Despite the presence of conflicting views, accountability strongly 
influences today's educational activities. A recent (1973) National Edu- 
cation Association document, "Survey of State iwiw/becre^^^ 
Activities Relating to Specific Areas Included in the Concept of Educa- 
tional Accountability," confirms that much work is being done in the 
following accountability- related areas: teacher evaluation, tenure/ 
continuing contract, performance-based certification, performance criter- 
ia, teacher needs assessment, student needs assessment, standardized 
testing, school program evaluation, goals/objectives, and management sys- 
tems. Widespread activity has also been documented in the report. State 
Educational Assessment Programs 1973 Revision^ published by Educational 



Testing Service (ETS) • Focusing specifically on the cissessment aspect 
of accountability, the report shows that all 50 states # as well as the 
District of Columbia, the Virgin Islands, and Puerto Rico, are involved 
in assessinent activities • ETS found 17 programs that collected data 
for state-level decision making, 13 programs that collected data for 
local-level decision making, and 24 assessment programs that were in a 
developcnental process or a planning staye. (Center for Statewide Edu- 
cational Assessment • • . 1973, pp. 1-8) 

VR\ile the concern in the '60& W2is whether education should have 
some kind of accountability system, the debate of the *70s no longer 
considers that choice; accountability in acme form is now inevitable • 
Today's concern heis a practical focus: how to make accountability work« 
Educational reseeurchers and writers in this decade are tirying to solve 
the specific problems related to accountability design and implementation. 
They are analyzing existing accountability programs, defining the elements 
needed in an accountability system, establishing criteria for judging the 
effectiveness of accountability programs, and theorizing about what ac- 
countability can and should do in order to improve the educational process. 

Recently, there has been an increasing trend for accountability sys- 
tems to be all inclusive. Teachers and administrators comprise only a 
part of the accountability pictvure. All persons, whether explicitly or 
implicitly involved in the educational process, are being included. For 
example, the wishes and desires of the communities served by educational 
institutions are now affecting educational decisions. In addition, stu- 
dents are exerting some influence; their opinions and feelings are af- 
fecting the goals and purposes of accountability systems. Another as- 
pect of all-inclusive participation in accountability progreuns is the 
work being done by local school boards and state legislatures. 

The attempt to involve so many people in the educational decision- 
making process has raised new questions. Decisions are needed concerning 
how to Involve these people. For example, what is the proper role for 
state departments of education? What is the most effective way for stu- 
dents and laymen to participate? Should legislators pasB accountability 
laws? The Cooperative Accountability Project (CAP) , based in Denver, 
Colorado, is attempting to answer such questions with its in-depth explor- 
ation of legislative mandates # criterion standards, model identification. 
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role expectations, and reporting practices* In a recent publication, CAP 

has undertaken the complicated task of outlining not only who has a role 

in accountability systems but also how that role could be performed* 

(Wilsey and Schroedor 1974) Such questions are far from being settled. 

Philosophies .^ the proper role for state departments of education 

are particularly varied* The following quotations indicate the diversity 

of positions oonc»^ming state department peurticipation in accountability* 

In a time of rapid and ever-accelerating social change, the 
state educati^on agency — that agency which has the funda- 
mentatl responsibility at least for public elementairy and 
secondary educaticn in a state—cannot reasonably be ex- 
pected to contribute to the direction of the chamges that 
are occurring, or to the iinprovement of education and 
at least indirectly cf society, if it simply continues to 
do only what it has done in the past* It must anticipate 
and prepare for its appropriate roles in the emerging fu- 
ture* * * * (if) the state education agency is to assume a 
bona fide leadership role in education, JLt must move away 
from the historic organizational and operationeU. concerns**- 
checking on compliance and doling out both money and ad«- 
vice— to new leadership and 8e:<yice activities that are 
less bureaucratic, less regulatory^ less bound by tradi- 
tions and structure, and mora concerned with pleaming, de- 
velopment, and change* (Morphet and Jesser 1972, pp* 61-63) 

Most state accountability proposals cauLl for more uniform 
standatrds across the state, greater prespecificatioh of ob- 
jectives, more careful analysis of leemiing sec[uences, and 
better testing of student perform2mce* These plans are 
doomed* What they biyLng is more bureaucracy, more sub- 
terfuge, emd more constraints on student opportunities to 
learn* The newly enacted school accountability laws will 
not succeed _in improving the quality of education for ajiy 
group of learners* * • * If state accountability laws are to 
be in the best interests of the people, they should protect 
local control of the schools, individueuLity of teachers, 2tnd 
diversity of learning opportunities* They should not allow 
school ineffectiveness to be more easily ignored by drawing 
attention to student perforaumce. They should not permit 
test scores to be overly influential in schoolwide or per** 
soned decisions— the irreducible errors of test scores 
should be recognized. The laws should make it easier for 
a school to be accountable to the community in providing 
a variety of high cpiality learning opportunities for every 
learner* (Stake 1972, pp* 3-4) 

In the first quotation, Morphet amd Jesser focus on the necessity 
for state agencies to take the role of leadership and to be creative in 
that role. In contrast. Stake, in the second excerpt, emphasizes the need 
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for local agencies to assume or retain responsibility. But even though 
the authors present different views concerning the type of state-level 
involvement/ they do agree to some extent that accountability offers 
an opportunity for improving education. 

Another area of difficulty appears when students and representatives 
of the cc»nmunity are included in developing an accountability system. 
(Bowers 1972, p. 2€) Broad-based involvement in any project is a formi- 
dable task in today's complex, changing, and transient society. Conse- 
quently, individuals who are responsible for obtaining local participation 
need special training. They need expertise in skills related to group 
dynamics and interpersonal oommiini cation. Once the community is brought 
into the educational process and ia asked to help define goals and/or 
objectives, there eurises the question of hew to vise the input. Undoubt- 
edly there will be a variety of ideas, many of them conflicting. There- 
fc.. a, plems for accoimtability programs must include methods for dealing 
with these oonflic±8« 

1. 3 Accountability and the Humanists 

The accountability movement has provoked mixed reactions from the 
humanists**<*fron those most deeply concerned with the sensitivities and 
potentials of tla*^ ix>dividual. Some humanists feau:^ that accountability 
will lead to a mechamical and limited treatment of education. Others 
regard it as a valuable concept, one vdiich provides the challenge and 
opportxanity to redefine educatior. Z goals and promote the well-being of 
every person in the educational environment. 

Those humanists who are skeptical warn that accountability could 
force educators to focus their attention mainly on easy- to- measure edu- 
.cational outcomes and thereby disregard the less tangible outcomes, those 
related to "huacm" development. ("Summary of NEA Conference ..." 
1973, p. 1) They also view accountability as a way of industrializing — 
and thereby dehumanizing^-education. Such a mechanical approach, they 
fear, will overshadow the importance of individual discovery and de- 
velopment. 

One humanist, Arthur W. Combs, coinnents on the limitations of cur- 
rent accountability practices: 
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I don't think anybody can be against accountability* Every- 
one ought to be accountable* What the humanist is constant- 
ly trying to make clear, however, is that accountability, as 
it is currently being practiced, is far too narrow a con- 
cept. And it is this narrpwness that seriously injures the 
educational process. (Combs 1973, p* 114) 

One of the limiting aspects criticized by the humanists is account- 
ability's en^hasis on precise, objective measurement for evaluating 
educational outcomes. Combs offers an alternative to objective measure- 
ment. He promotes subjective judgment as an important evaluation tech- 
nique; 

To deal with the hvunanist aspects of accountability, we have 
to insist on the validity of humcin judgment for evaluation. 
We have sold ourselves a bill of goods in our insistence 
on being objective. Objectivity is fine when you have it. 
But judgment is what we use when we are uneUDle to deal pre- 
cisely and objectively with a particular event. If we throw 
out, jtidgment in the evaluation of educational outcomes, we 
have thrown out a most important tool. Judgment is what 
education is all about; in fact, the goal of education is 
to improve humam judgment. If teachers are not allowed to 
use judgment to determine what is happening then what we 
have done is rule out the very quetlity that makes them most 
effective in the long run. (Conibs 1973, p. 121) 

Another concern of some humanists is that objective measurement and 
^ evalviation could lead to standardized, homogenized education. They fear 
that educational diversity, which requires flexibility, heterogeneity, 
and freedom of choice, will ba sacrificed. One educator, when emphasiz- 
ing the importance of diversified educational opportunities, has warned 
that accountability enthusiasts could hm pushing education toward a na- 
tionally regimented curriculim. (Baker 1973, P* 1) 

While some humanists criticize the consequences of limited account- 
ability programs, others react more favorably. Working from a philosophi- 
cal perspective, they interpret accountability £Ui.an opportunity to pro- 
mote the growth of* every person in the educational ccxnmunity. Essential 
to their thinking is "a growing awareness that the healthy, human society 
is the helping society in which each of us becomes the responsible care- 
taker of ourselves." (Richards et ai. 1973, p. 247) A new and compre*- 
hensive approach to accountability is envisioned* 

[They] propose a concept of accountability which concerns 
itself not merely with the performamce of measureable, 
designated, and liniited educational goals, but with the 
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goal of facilitating the increased adequacy and well-being 
of every person in the school environment, [The] proposal 
is a basic one. It does not assume to define specific 
procedures for impo9ing accountability on anyone. It 
focuses on an understanding of accountability without 
which no attengpt to make others accountable will succeed 
in making the school environment more healthy euid humane. 
(Richards et al. 1973, p. 247) 



1.4 Accountability and the Social Studies 

The issiies raised by the humanists are particularly relevant to 
accountability in the social studies. Many social studies educators 
feel that it is much more difficult to achieve a consensus on goals and 
objectives in social studies than it is, say, in math or reading. Does 
this mean that the resulting consensus will be much less meaningful? 
Once deciued upon, many intt>orteuit social studies goals are considered 
difficult to operationalize and measure. Does this mean that they will 
be ignored? Many feel that since these issues are somewhat unique to 
social studies, the processes and procedures for determining social 
studies goals and objectives should be different from other subject 
areas. 

Nationedly, accountability-^'-maihly in terms of assessment activi- 
ties — has had its greatest impact in math and reading. These subject 
areas are generally granted high priority by state departments of edu- 
cation and £u:e considered relatively easy to measure. Despite this na- 
tional trend, however, a few states are giving social studies consider- 
able attention in their acootintabillty programs. 

For the past several years the Michigan Department of Education, 
following its general accountability model, has been developing perform- 
ance objectives in social studies cind other subject areas. The objeo- 
t.lves developed at the state level will serve as a model to Michigan . 
school districts that axe designing their own educational programs. 
Robert L. TreziSe, the Social Studies Specialist in Michigan's Depart- 
ment of Education, praises the results of his state's efforts in de- 
veloping social studies objectives: 

[At first] many people — including myself — were skeptical 
of putting socieil studies in student-parformance terms, 
because, we all said, while such "skillsy" areas cis read- 
ing amd mathematics might lend themselves to definition 
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by parformance objectives, social studies is too open-ended # 
too broadly humanistic# too subjective an area for this kind 
of treatment* Reduce social studies to performance objec- 
tives, the reasoning went, and you kill the heart of the 
matter* • . . [However,] having spent this period of time 
in an attempt to define minimal performance objectives in 
the social studies, I can say personally • • • that search- 
ing for the basics in student-performance terminology has 
been a most rewcirding experience; for in attempting to state 
specifically and precisely what it is we might expect young- 
sters to do and to know as a result of instruction in the 
social studies/ one's own thinking is greatly clarified* 
And bringing clarity and precision to an area like the soc- 
ial studies, which tends to be ill defined and a hodge- 
podge of pui^ses/ can only be to the good* As a matter of 
fact, it is the very vagueness • • • of social studies that 
makes it all the more appropriate an area in which to ap- 
ply . • • performance objectives* (Trezise 1974, p. 25) 

According to Michigan educators, accountability has benefited the social 

studies. By developing performance objectives, social studies educators 

have had to clarify fuzzy thinking, reduce things to their essentials, 

and define things in clear and spare language—efforts which have brought 

precision to a previously uncleeur area. (Trezise 1974, p. 24) 
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2.0 A Proposed General Accountability Model 

To assist state department personnel and others engaged in planning 
accountability programs, we have developed a general model that defines 
and integrates the various components of accountability. The model, which 
is shown in Figure 1 on the next page, is based on the definition of ac- 
countability given at the beginning of this report. It Is very general 
and encompasses, or at least implies, all aspects frequently included in 
discussions or models of accountability. 

This model has two distinct functions. It can be used to help des- 
cribe what is— the current state of affairs in a single school district 
or state or in a number of districts or states. It can also be used to 
describe what ought to be— a desired state of affairs which may or may 
not coincide ^ith what actually exists. 

Although our model relates to general accountability activities, it 
can be applied specifically to social studies programs by identifying, 
social studies concerns in each step of the model. For example, if the 
model were to be used to plan a social studies accounttibility program 
in a state or district, the desired outcomes determined in step 2 would 
be social studies outcomes rather than general educational outcomes or 
outcomes for "another subject area. While .he desired outcomes or pro- 
gram design for a social studies accountability program would differ from 
those for a math accountability program, we believe the processes involved 
would be the same. 

2.1 The Educational Constituency 

The first element presented in the general model is the educational 
constituency, step A-1. This component includes the persons, groups, or 
institutions that initiate major educational decisions and to whom the 
educational' system is responsible. It might be an exclusive group that 
includes only the legislature and the board of education, or it might be 
more conprehensive and include administrators, voters, and others. A 
major emphasis in the current accountability movement is to have a very 
broad constituency, one which in some cases includes legislators, teach- 
ers, administrators, parents, taxpayers, thi'pubiicT at "large, and occa-r 
sionally students. 
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Figure 1, A General Accountability Model 
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The roore ccn4>rehensive the educational constituency, the more the 
roles of different constituents are likely to vary. Some constituent 
groups, such as legislators or citizens, may have limited roles eind af- 
fect only two operations of the system — resource allocation and goal 
determination. However, other persons, such as superintendents or teach- 
ers, may play a more coinprehensive role, taking part in many of the oper- 
ations shown in the model. In addition to influencing allocation of funds 
and definition of goals, they may participate in identifying specific 
objectives, conducting assessment activities, designing educational pro- 
grams, and so on. 

The educ&tionad constituency is different from the rest of the com- 
ponents in the model. It consists of pt vsonSf whereas the other steps 
represent operations or functions. As the decision-making body that 
starts the system working, the constituency initiates two major sets 
of operations, indicated by the left and right sides of the model — 
fiscal operations and program operations* In the past it has been com- 
mon for the two sets of operations to proceed rather independently of 
each other. Legislators emd others concerned with fiscal operations have 
made the major decisions about how much money will be available for oper- 
ation of the system, and business managers have attended to the fiscal 
responsibility of the system; but neither of these groups has contributed 
Slabs tantially to program design or measurement of achievement. The 
professional educators, on the other hand, particularly those below the 
superintendent level, have been primeurily concerned with planning and 
carrying out the program operations and have had little concern with mat- 
ters such as cost effectiveness — a term that has sometinves thrown edu- 
cators into a state of defensiveness or shock* 

xt is the essence of accountability that the two sides of the gener- 
al model be brou^t into closer relationship — that alternative sets of 
plans be related to the corresponding costs, that past expenditures be 
judged by demonstrated accomplishments, that those who make the budget- 
ary decisions look more closely at the plans and outcomes of education, 
and that those who operate the educational programs become more con- 
cerned with the relationships between planned programs, demonstrable out- 
comes, and costs. 
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2.2 Fiscal Operations 

Resource allocation (step B) , the first component of the fiscal oper- 
ations, represents a major decision made by the educational constituency 
or subsets of it. During this piiase of the model, resources for achiev- 
ing educational outcomes are determined. Usually legislators, voters, and 
school boards make most of the immediate decisions about total money re- 
sources available for an educational system; they may also designate ex- 
penditures for some specific items in the budget. Other groups in the 
constituency may influence the legislators and boaurds as they make these 
decisions. For example, the general public can exercise vague but impor- 
tant influence over legislative allocation bf total money resources and 
administrators can affect specific allotments of the total budget, in 
addition to the money allocated by legislators and school boards, other 
resotarces are available to svqpplanent school funds. Volvmteer services 
performed by community citizens cmd school fund-redsing projects auce two 
such sources. 

The next component in the general model is program plemning and bud- 
geting, step C. During this operation, sometimes given other titles, 
detailed fiscal planning is related to program planning. In fact, this 
step might be related to all aspects of the right side of the model, but 
additional arrovrs have been omitted for the sake of simplicity. 

Following prograun planning cmd budgeting is step D, benefit/cost 
analysis, in this conqponent achievements are compared with costs of total 
programs and/or parts of programs to determine which ones give the great- 
est aresults per unit of resources. Benefit/cost euialysis may also be done 
at the earlier planning stages to oompsure eacpected benefits and costs of 
proposed programs. 

Finally, on the fiscal side, recommendations for improvement (step 
E) are made and tremsmitted back to both the program planners (step C) and 
the educational constituency (step A-1) . 

2.3 Program Operations 

Parallel to the fiscal activities in the model is a second major set 
of operations initiated by the educational constituency. This set, shown 
by the right side of the model, concerns the program aspects of accounta- 
bility operations. 
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In the model, program operations begin with step 2, determining de- 
sired outcomes ♦ This step concerns the defining of broad, general out- 
comes: such outcomes are sometimes called goals in educational terminolo- 
gy. Step 3 of the model refers to defining more specific objectives* 
In some instances these objectives might be performance objectives. 
Actually the desired outcomes-objectives distinction should be considered 
a« continuum rather than a dichotomy. 

Needs assessment, step 4, represents the process of comparing the 
desired state of affairs, as determined in steps 2 and 3, with the actual 
state of affairs. Needs assessment necessitates measurement of the exist- 
ing educational situation. Substeps 4a and 4b reflect two coinmonly used 
measurement procedures. Citizen surveys (step 4a) are sometimes used to 
assess the public's opinion of educational needs. Measuring the status 
of learners (step 4b) involves testing students with standardized instru- 
ments to determine achievement levels. Once survey or testing activi- 
ties are conflate, the results are compared with desired outcomes and 
objectives to determine needs. 

Based on assessed needs, educational programs are designed (step 5) 
which will meet the specified needs. The next step is to implement the 
program (step 6), then the program results must be measured (step 7). 
This measurement may include any procedures considered appropriate for 
determining progress toward the stated objectives. The arrow between 
steps 7 and 4b indicates that the same methods and/or measurement may 
serve both components The methods, or instruments, developed in step 
4b could also be used in step 7. In addition, the results of measure- 
ment occurring in step 7 could also be used to reflect learner status, 
step 4b. 

After results are measured, recommendations for in^rovements, step 
8, are made and communicated back to various decision-making points in 
the system. While the recommendations, if implemented, atfect all parts 
of the system in some way, they most directly influence two areas of 
decision making: general policy (as determined by the educational con- 
stituency in step A-1) and program design, step 5. 

2>4 Roles 

This model outlines a means for systematically conceptualizing and 
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implementing accountability. A useful supplement to the model is presented 
by Wilsey and Schroeder (1974) ^ who have identified the roles of the in- 
dividuals and groups that play an important part in educational accounta- 
bility: state legislature/ governor, state depeurtment of education , state 
board of education, local school board, community members and groups, 
citizens* conmittees, superintendent of schools, district administrators 
and supervisors, principals, teachers, students, teachers' organizations, 
other school-related organizations, and consultants. The roles played by 
each of these groups or individuals are described with respect to speci- 
fic accountability processes, including selecting gocls, detemdning ob- 
jectives, ancdyzing alternative programs and activities, developing or 
revising program activities, developing program accounting and budgeting 
procedures, establishing time tables, evaluating achievement of objec- 
tives, reporting to the public, and evaluating and revising the accounta- 
bility system. 

In specifying participemts* roles in these accountability processes, 
Wilsey and Schroeder reconriend that the role for state departments of edu- 
cation in each process is to advise, provide consulting or training ser- 
vices and funding, recommend action to the state board or legislature, 
and supervise, control, evcd.uate, or enforce the accountability program. 
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3>0 Purpose and Methodology of This Report 

3>1 Purpose and Scope of the Report 

Observing the momentum behind educational accountability, the ERIC 
Clearinghouse for Social Studies/Social Science Education (ERIC/ChESS) 
sponsored a nationwide survey of persons in state departments of educa- 
tion to examine accountability activity in the various states and to 
determine the status of social studies in the accountability movement. 

We were interested in answers to severauL questions about general 
accountability programs. How are such programs initiated and implemented? 
What procedures are being followed in accountability activities? Who 
is pressuring for accountability? What seem to be the future trends in 
accountability? Within the contelct of general accountability programs, 
we were particularly interested in emswers to questions concerning the 
status of social studies. To what extent is social studies included in 
the accountability programs of 'various states? What procedures are being 
followed in social studies accountability? What is the future of social 
studies in the accountability movement? 

We felt that answers to these questions and others would provide a 
usef\:l picture of account2d3ility programs in the 50 states and the status 
of social studies in those programs. We hope^d the answers would provide 
state departments of education as well as other interested persons '-'ith 
heir^ful information for designing, implementing, evaluating, or modify- 
ing accountability programs in the social studies. 

The concept of accountability is quite complex, and authorities do 
not always agree on which activities properly fall within its scope. Per 
purposes of this report we limited our discussion of accoiantability pri- 
Viarily to program-related activities such as determining desired outcomes, 
specifying educational objectives, assessing needs, designing programs, 
and evaluating progreuns. We did some general analysis of how funds al- 
location is tied to accountability in various states, but we did not deal 
with fiscal considerations and management methods such as educational 
vouchers, uniform accounting systems, budgeting systems, or management 
information systems. Neither did we consider performance contracting 
or evaluation of educational employees. These cureas and others are often 
(and logically) included in state accountability practices, but we chose 
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to focus more specifically on the program components of accountability. 

While we have excluded some fiscal i management, and other consider- 
ations from our accountability discussion, we have extended our scope to 
include any accountability-related activity in which a state is engaged, 
even if the activity is not part of a comprehensive accountability pro- 
gram. For example, a state may be engaged in a student testing activity 
but not have a comprehensive accountability program in effect or even proj 
jected. In such instances, we have categorized the state's testing pro- 
gram as an accountability-related activity (needs assessment) and included 
the activity in our analyses of accountability programs. 
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3.2 Data Collection 

The method we chose to collect data for our report was to interview, 
by telephone, representatives from state departments of education. Ini- 
tially we planned to include data from all 50 states; however, representa- 
tives from two states, Illinois suid Tennessee, declined to participate. 
Thus our final report deals with accountability in 48 states. Appendix A 
contains a list of all survey participants. 

We attempted to get a comprehensive view of accountability in each 
state by identifying and interviewing two representatives from each. One 
representative was to be the social studies specialist or consultant from 
the state depcurtment of education, in 17 states we f9und there were no 
social studies specialists, so state department curriculum generalists 
were interviewed instead. 

The second interviewee we originally planned to contact in each state 
was the person responsible for state-level accountability programs. How-' 
ever, we found only one state, Florida, actually exnployed such a staff member. 
In the remaining states we had to trace the person most closely associated 
with accountability planning. The titles of such people included Director 
of Evaluation and Planning, Director of Research, Director of Assessment, 
Supervisor of Testing, Assistant Commissioner for Long-Range Planning, . 
and Associate Commissioner of Education, in this report, the second group 
of interviewees is called "evaluation personnel." 

The telephone interviews were conducted in two rounds from September 
to mid-November 1973. Social studies specialists were contacted during * 
the first round and evaluation personnel during the second. Similar but 
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somewhat different questionnaires were designed and used in interview- 
ing the two types of representatives (see Appendix A) . All conversa- 
tions were recorded on cassettes (with permission) and later transcribed. 
The resulting transcriptions produced most of the data appearing in this 
report. Because we were able to interview only one representative from 
South Dakota, a total of 97 interviews were completed. 

Our data collection procedure produced some problems. First, the 
disparate nature of the accountability concept caused our questions to 
be interpreted in a wide variety of ways. Although we provided inter- 
viewees a definition of accountability (the one presented in the intro- 
duction to this report), respondents' answers sometimes went outside this 
definition, touching on subjects such as district autonomy, community 
control of schools, performance contracting, management by objectives, 
school accreditation, educational vouchers, management information sys- 
tems, and performance-based teacher certification. Dealing with such 
diverse interpretations and terminology made later data analysis diffi- 
cult. 

Another problem produced by our data collection procedure seems 
inherent in the open-ended questioning design of the survey. The amount 
of data gathered with the technique was extensive and usually informative, 
but it was also unfocused. The open-ended questioning may have also 
contributed to the few instances when seemingly conflicting information 
was given by the two representatives from the same state. Certainly the 
massive amount of data produced in our interviewing proved cumbersome to 
quantify. 

3.3 Conference 

From the survey findings and additional information we abstracted 
from various state department of education publications, we drafted a 
preliminary report. This working paper was then presented at a two-day 
conference on education2LL accountability sponsored by ERIC/ChESS and 
held in Boulder, Colorado, in December 1973. The conference participants 
reviewed the draft and made suggestions for preparing our final report. 
(Names of conference participants appear in Appendix A.) 
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3*4 Verification of Survey Data 

In January 1974 tliree charts showing our interpretation of the sur- 
vey findings for each state were mailed to all participants ♦ Appendix A 
contains samples of the items mailed in the verification procedure ♦ Veri- 
fication charts 1 and 2 showed the degree to which each state performed 
four accountability- related activities— determining desired educational 
outcomes (goals), specifying educational objectives, measuring status of 
learners, and designing educational programs* Activities were defined 
for curricular areas in general and for the social studies in particular. 
Chart 3 showed the degree of state and local cooperation in each of these 
four activities* 

Of the original 98 interviewees receiving the verification charts, 
36 participants representing 22 states responded. These respondents each 
returned various suggestions and corrections to our interpretation of their 
state's accoxintability activities. The varied reactions to these charts 
demonstrated that the accountability movement* is still young and not clear- 
ly defined. Howewr, using the suggestions and corrections given by re- 
spondents, we made our data reflect existing progreuns as accurately as 
possible. 

We also used several documents dealing v/itli accountability to aid in 
verifying our survey data. Details of state assessment activities were 
checked with State Education Assessment Progrrains 197^ Revision (Center for 
Statewide Educational Assessment . . . 1973) , published by the Educational 
Testing Service and referred l;o in this report as the ETS roport. Two 
Cooperative Accountability Project publications, Legrislation by the States: 
Accountability and Assessment in Education (Hawthorne 1973a) and Character-- 
istics of and Proposed Models for' State Accountability Legislation (Haw- 
thorne 1973b) , were used to corroborate our data on legislated accounta- 
bility activities. Doris M. Ross's report, "1973 State Education Legis- 
lation and Activity: Genercil Govemcmce cuid Administration — Survey of 
the States," provided still another source for checking our information. 
We acknowledge the usefulness of these four publications but of course 
accept responsibility for any errors appearing in this report. 
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4,0 Analysis of Survey Data 



The analysis that appears in this section of the paper is based pri- 
marily on the data collected in our telephone survey of representatives 
from the 48 participating states. When other sources are used, appropri- 
ate reference is made. In the data analysis we attempt to answer the 
questions about educational accountability that prompted the initial 
interest in this study. 

4,1 Acc ountability Program Titles; What Are Programs Being Called? 

Our first examination of the survey data was made to determine what 
the states were titling their accountability programs. Although there 
were few exact duplications among the program titles, it was possible to 
categorize them by the key phrase appearing in each title. Table 1 shows 
the results of this emalysis. 



Table 1. Accountability Program Titles 



Key Phrase- in Title Number 


of States 


"Needs Assessment" 


17 


"Educational Assessment" 


17 


"Educational Accountability" 


3 


"Statewide Testing" 


3 


"Evaluation" 


2 


TSo Title 


2 


Other 


4 


"Continuing Plan of Education in Mississippi" 




"New York State Assessment and Evaluation System" 




"Public School Approval Process in Vermont" 




"Statewide Search for Consensus" (Ohio) 





As Table 1 indicates, the majority of states are calling their ac- 
countability programs either "needs assessment" or "educational assess- 
ment." The emphasis on assessment in the program names corresponds with 
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the strong einphasis on assessment activities we found when we analyzed 
what the states are actually doing in their accountability programs (see 
Table 8) . 

In view of the common \ise of the term assessment and the infrequent 
use of the term accountability it might be^ argued that this report should 
carry the former rather than the latter in its title. However, the em- 
phasis on accountability has been retained for two reasons. First, much 
of the discussion in the literature and elsewhere focuses on the term 
accoimtability rather than assessment. Second, assessment^ as shown in 
the model presented in Section 2.0, comprises only a part of the wlxcle 
process of accountability. In this report we are interested in complete 
accountability systems, not just in the single activity of assessment. 

4,2 Origins of Accountability Programs: Who Initiates Accountability 
Programs? 

Using our survey data and information in the ETS report, the origins 
of accountability programs were analyzed. The purpose of this analysis 
was to determine who was responsible for initiating the accountability 
activities in each state. Results of the tabulation are shown in Table 2. 



Table 2. Origins of Accoimtability Programs 



Initiator NimihAr- nf fixate*? 


state Department of Education (SDE) 


29 


Legislative Maiidate 


5 


Special Accountability Agency a: Division 


3 


State Board of Education (SBE) 


2 


ESEA Title III Office 


1 


Combined Effort 


8 


(Confcinations include: SDE and SBE; SBE, SDE, 
and legislature; SBE, SDE, governor, and legis- 
lature; city board of education and SDE; 
board of regents, SDE, and teachers • association; 
SBE and governor*) 
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Our data show that by far the most comnon initiator of accounta- 
bility programs in states is the State Department of Education (also 
called the State Education Agency or Department of Public Instruction 
in some states) • It was not always possible to determine from our in- 
formation what motivated the state departments to originate such pro- 
grams • Some respondents did mention that their programs were begun in 
response to the requirements of the ESEA Title III funds received by 
their state. 

4.3 AccQiontability Legislation; Is Educational Accountability Being 
Legislated? 

Because legislation is thought by some to be important to accounta- 
bility programs, we decided to look closely at how many states have en- 
acted or proposed legislation relating to educational accountability. 
The findings appeeo: in Table 3. 



Table 3. Educational Accountability Legislation 



Status of Legislation 

Legislative mandate originated accounta- 
bility program 

Legislation passed after initiation of 
accountcdDility program 



States having enacted legislation 
Legislation pending (baised on Pall 1973 
reports) 



Number of States 



12 
17 



Table 3 indicates that the legislative push for accountability is 
not particularly strong. With only 17 states having enacted legislation 
and two others having legislation pending, it does not seem legislatures, 
as a group, are zealousl;; pushing accountability, at least by statute. 
However, it is possible that legislators are exerting pressure other than 
statute requirements to make education more accountable. 
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4,4 Funding Sources of Accountability Programs; Who Is Paying for 
Accountability Programs? 

To determine how accountability programs are being financed, we 
used both our own data and data from the ETS report. Table 4 shows the 
tabulation of results. 



Table 4. Funding Sources of Accountability Programs 



Funding Sotarces 


Number of States 


Only federal sources 


23 


Only state sources 


8 


Combination state- federal sources 


10 


Combination state-federal- local sources 


3 


Combination federal- local sources 


2 


Combination state-local sources 




Total 


47* 


♦Oregon reports no funding for its accountability-- 
related activities. 



It is clear from Table 4 that accountability program are relying 
heavily on federal funding. Thirty-six use federal funding for their 
accountability activities. In Table 5 on the next page, a more detailed 
breakdown of federal sources involved in accountability programs is pre- 
sented. 

4.5 Roles of State Departments of Education in Accountability; What 
Are State Departments Doing in Accountability? 

We were interested in analyzing what state departments are doing 
in the accountability movement. First, we eisked respondents what agent 
determined the role of the state depaartment in their staters accounta- 
bility program. Table 6 on the next page summarizes their responses. 
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Table 5. Sotirces of Federal Funding in Accountability Programs* 



Federal Funding Source 


Number of States 


Only ESEA Title III 


14 


Only ESEA Title V 


2 


Only ESEA Title IV. <5ection dOO 




Combination of Titles I and III 


5 


Combination of Titles III and IV 


4 


Combination of Titles I, III, and V 


3 


Other Combinations 


7 


*Brief descriptions of the four Titles of the Elementary and 
Secondeury Education Act of 1965 are as follows: 
Title I— -Financial Assistance to local education agencies for 

the education of children of low-income families 
Title III — Supplementary educational centers and services 

(innovative programs) 
Title rv, section 402 — Educational research and research training 
Title V~Grants to strengthen state departments of education 


Table 6* Summary of Agents Determining Roles of State 
Departments of Education in Accountability 


Determining Agents 


Number of States 


Single Agent 




State Department of Education 


8 


State Board of Education 


5 


Statute 


5 


Chief State School Officer 


3 


Title III 


2 


Coinnunity involvement 


2 


Legislative Resolution 


1 


Governor's Office 


1 


Combination of Agents 


20 


No Agents Cited 


1 
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Table 6 shows that in 27 states the state department's role is being 
determined by a single agent; however, the agents vary. No single agent 
dominates, but it does appear that state departments themselves, or their 
chief state school officers, often determine what role they will play in 
ac CO unr ab i 1 i ty . 

The combination of determining agents reported by the remaining 21 
states was too diffuse to tabulate profitably, so Table 7, on the follow- 
ing page, was prepared to show specifically what agents are determining 
the state department's accountability role in each of the 48 states parti- 
cipating in our survey. 
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X 




Maryland 




X 


1 — 


i 












Massachusetts 






1 


1 X 












Michigan 




X 


1 






X 








Minnesota 




i 


X 


1 




X 






X 


Mississippi 






X 












X 


Missouri 




: t X 


- 








X 




Montana 


X 


: X ; 






X 








Nebraska 


1 

1 


r 










X 


Kevoda 




i 


X 






X 








New Hampshire 






X 














New Jersey 








X 




X 




X 




New Mexico 




X 










1 




New York 






X 








i 




North Carolina 




J 

* 








X 


1 

1 




North Dakota 




1 












X 




Ohio 




X 


















Oklahora 




X 


















Oregon 








X 


X 




X 








Pennsylvania 




X 


















Rhode Island 






X 


X 














South Carolina 










X 












South Dakota 






X 










X 


X 


X 


Texas 










X 












Utah 




















X 


Venaont 






X 


X 


X 












VlrRinia 








X 














Washington 














X 








West Virginia 








X 














Uiscon':in 












X 


X 




Uyoaint: 










X 
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To detemdne what role state departments of education are presently 
playing in accountability, we asked each respondent to describe his/her 
departnvent » s function in accountability. Responses are shown in Table 8. 



Table 8. Roles of State Departments of Education in 
Accountability Programs/Activities 



Present Role 


Number of States 


Developing and implementing an accounta- 
bility progrcun 


11 


Implementing needs assessment activity 


. 9 


Supporting and/or advising local accountability 
activities 


9 


Developing an accountability program 


7 


Providing leadership in joint state/local 
accountability activities 


6 


Cariying out legislation 


2 


Preparing information for future legislation 


1 


Role unclesu: or playing no role 


3 



The roles of state departments of education, as described in Table 8 , 
are diverse. The 13. respondents who indicated their departments were de- 
veloping and implementing accountability programs view their departments 
as the "prime movers" behind accountability. The representatives who 
describe their department's role as "providing leadership in joint state/ 
local activities" perceive their agency as instrumental in, but not to- 
tally responsible for, accountability. Other respondents see their depart- 
ment's role as completely advisory and/or supportive. 
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li^ status of Accountability Procyrams: What's Happening in Accountability? 

While the central aim of our survey was to determine the status of soc- 
ial studies in the accountability program of each state, we found it neces- 
sary to examine the overall accountability program of a state before focus- • 
ing specifically on its social studies activities. An initial review, of 
our data showed that accountability programs veuried considerably in termi- 
nology, activities, and procedures. To deal with this diversity, we used 
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the accountability model presented in Section 2.0 of this paper as the 
basis for analyzing the accountability progrcims in the 48 states sur- 
veyed. 

There were two advcmtages in using the accountability model as the 
basis of analysis. First, the model helped us translate* the numerous 
terms used by states to describe their activities and approaches into a 
conmon terminology. Second, the stages of accountcdjility activity speci- 
fied by the model provided a starting point for analyzing and comparing 
the procedures actually being used in various states. 

The major problem in using the model as a basis of analysis was that 
the activities or procedures, as described by respondents, did not always 
fit neatly into the steps specified in the model. In some instances, 
incomplete or vague data also made interpretation difficult. However, 
we have attempted to represent fairly and accurately each state's pro- 
gram in our analysis. 

The part of the accountability model used in analyzing state ac- 
countability program operations is shown in Figure 2 on the following 
page. 

Using the model, we analyzed our data to determine how many states 
had completed or were presently involved in steps two through eight. 
Table 9 shows the results of the analysis. 



Table 9. Steps Taken in Accountability Programs 



Step (as defined by model) 


Number of States 


Determined Desired Outcomes (step 2) 




38 


Educational Objectives Specified (step 3) 




6 


Conducted Needs Assessment (completed or 


in 




progress) (step 4) 




44 


Conducted only student testing 


25 




Conducted only citizen survey 


5- 




Conducted both testing and survey 


14 





Table 9 stops with step 4 of the model because, by our analysis, 
no state has progressed beyond that step in its accountability program. 
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Figure 2. A Partial Accountability Model 



(A-1) EDUCATIONAL CONSTITUENCY 
Parents, Students, Teachers, 
Voters, Legislators, Admin- 
istratorSf etc. 



(2) 


Determining 
DESIRED OUTCOMES 


\ 


/ 


(3) 


Specifying 

EDUCATIONAL 

OBJECTIVES 


\ 


/ 


(4) 


Conducting 
NEEDS 

ASSESSMENT 


N 


/ 


(5) 


Designing 

EDUCATIONAL 

PROGRAM 


\ 


/ 


(6) 


Implementing 

EDUCATIONAL 

PROGRAM 


\ 


/ 


(7) 


Measuring 
RESULTS of 
the Program 


\ 


/ 


(8) 


Recommending 
IMPROVEMENTS 



\ 



\ 



\ 



< 



\ 




\ 



(4a) 



Surveying 

CITIZfN 

OPINION 




(4b) 



Measuring 
STATUS OF 
LBABNERS 
(Testing) 



I 
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PROGRAM 
OPERATIONS 
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That is not to say that states have not been involved in designing or 
implementing educational programs. Howevsr, in answering our survey 
questions, the state representatives indicated that such program design 
activitier were not considered part of the accountability program in 
their states, at least at this time. 

The above table shows that most states have determined some type of 
desired outcomes (goals) for education. In. reviewing documeuLs published 
by the various states, we found the specificity of these goals varied 
■ considerably. Many states have specified ten or twelve broad goals, of- 
ten published in attractive brochure form, which indicate the general 
direction the state plans to go in education. 

Step 3 in our model calls for the specifying of educational objec- 
tives; this step includes, but is not limited to, performance objec- 
tives. As can be seen in Table 9, few states—only six—indicated they 
had specified educational objectives. A number of respondents indicated 
their states would begin specifying educational objectives after con- 
ducting needs assessment activities rather than before. 

The step presently generating the most activity on the accountability 
scene, according to our data, is the needs assessment step. As shown in 
thr; analysis of program tit3.es (Table 1) , many states label their account- 
ability programs "needs assessment." However, the concept of needs 
assessmor.t seems to vary considerably from state to state. 

Table 9 shows that 25 states base their needs assessment activity on 
a student testing program. Testing programs range from extensive to 
minimal, but all involve some sort of standardized testing of student 
achievement. (Testing programs are discussed in more detail below.) 
Presumably the actual testing is only part of the total needs assess- 
ment step;-. from the test restilts needs will be determined by comparing 
test results with predetermined desired objectives or standards. How- 
ever, since states are presently in the middle of their student testing 
program, or j us tc.=be ginning them, it is not possible to determine what use 
will be made of the testing results. 

A second needs assessment activity which has been con^Jleted in 19 
states is a citizen survey. In such surveys, citizens of the state are 
asked to indicate what tlxey feel are the educational needs of the state's 
population. Some surveys have used extensive questionnaires, others 
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brief forms. The number of people surveyed has varied from a few hundred 
to several thousand. A few states have used the results of their surveys 
to heir; determine their desired outcomes (goals) . Fourteen states have 
conducted both a citizen survey and a student testing program. 

In tabulting figures for Table 9 it became clear that, while many 
states were involved in one or more of the steps in our accountability 
model, they were not necessarily progressing through those oteps in the 
order shown in the model. Therefore, we analyzed the direction t>e states 
are proceeding in their accountability programs by showing their activities 
on flow charts. Determining direction was not easy and sometimes involved 
synthesizing answers given to several survey que jns. The results of 
this analysis in shown in Table 10. 



Table 10. Progression of Accountability Activities 



Progression of Steps Number of States 

Desired Outccunes ^ Needs Assessment (Testing) 15 

Needs AssessDient (Survey) ^ Desired Outcomes- 
Needs Assfissment (Testing) 

Needs Assessment (Testing) — ^ 

Needs Assessment (Survey) ^ Desired Outcomes 

Needs Assessment (Testing) Desired Outcomes 

Desired Outcomes 

Needs Assessment (Survey) 



Needs Assessment (Survey) 
tives ^ 



^ Educational Objec- 

Needs Assessment (Testing) ^ 



Desired Outcomes 

Needs Assessment (Survey) ^ Desired Outcomes N 

Needs Assessment (Testing) ^ Educational 

Objectives 

Needs Assessment (Testing and Survey) 
Outcomes 

Desired Outcomes ^ Educational Objectives 

Needs Assessment (Testing) ^ Needs Assessment 

(Survey) 

No Steps Taken 



Desired 



10 
7 

4 

"> 

2 
1 



1 
1 

1 
1 
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As Table. 10 shows, accountability is progressing in many diverse 
ways within the states. Perhaps the nvost obvious difference among pro- 
grams is the first step taken by the state, some states start with de- 
sired outcomes- (usually broad goal statements); other states begin with 
seme sort of needs assessment activity (either testing or a survey) . A 
quick computation of the Table 10 figures shows that 18 states began 
their accountability process by determining desired outcomes, while 29 
states began with a needs assessment activity. Perhaps some of these 
states began with the needs assessment step because they had ongoing 
student testing programs before the concept of accountability came to 
the forefront; it was most convenient to begin their accountability 
programs with an activity already in progress. 

Table 11 # on the following page, presents a state by state suiranary 
of accountability programs as described by participants in our survey 
and verified by other previously mentioned sources. 

4.7 Accountabilit y Publications: What Are States Writing about Their 
Programs? 

In our telephone interviews with representatives from the states, 
we asked them to send us any documents or publications relating to ac- 
countability that had been published in their states. We received such 
documents from 37 states and used them to supplement our telephone data 
when preparing Table 11. Appendix D presents an annotated bibliography 
of the documents we received that we think may be of interest to readers 
of this paper. 

An analysis of the publications themselves showed much diversity in 
the way states are describing and publicizing their accountability ac- 
tivities. Essentially we received three types of documents. One type, 
which many states have, is a short pamphlet or brochure which outlines 
the broad educational goals for the state. These publications usually 
seem to be aimed at the general public and probably could be considered 
a public relations effort. 

Several states that have needs assessment testing programs have 
produced publications showing the results of the testing programs; 
similar documents have been produced when an extensive citizen survey 
has been completed. The information in these documents tends to be 
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Table 11: State by State Svnaary of Accountability Prograns 







Determined or 
Detemlning 
Desired Outcomes 
(Goals) 


Conducted or 
Conducting 
Needs Assessment 
(Testing) 


Conducted or 
Conducting 
Needs Assessment 
(Survey) 


Specified or 
Specifying 
Educational 
Objectives 






ALABAMA 




X 




X 






ALASKA 


X 




X 








ARIZONA 




X 










ARKANSAS 




X 










CALIP0I91XA 




X 










COLORADO 


X 


X 










CONNECTIOrr 


X 




X 








DELAWARE 


X 


X 










FLORIDA 
GEORGIA 


X 
X 


X 
X 


X 








HAWAII 


X 


X 










IDAHO 


X 


X 










INDIANA ' 


X 


X 










IOWA 




X 








i KANSAS 


X 


X 


X 






« KENTUCKY 


X 


X 


X 


X 






LOUISIANA 


X 


X 










MAINE 


X 


X 




X 






MARY LAND 


X 


X 










MASSACHUSETTS 


X 


X 


X 








MICHIGAN 


X 


X 


X 


X 






MINNESOTA 


X 


X 










MISSISSIPPI 


X 


X 










MISSOURI 


X 




X 


X 






MONTANA 


X 












NEBRASKA 


X 


X 


X 


- 






VEVADA 


X 


X 










NEW HAMPSHIRE 




X 










NEW JERSEY 


X 


X 


X 








NEW MEXICO 


X 


X 










NEW YORK 


X 


X 










NORTH CAROLINA 


X 


X 










NORTH DAKOTA 




X 










OHIO 






X 








OKLAHOMA 


X 




X 








OREGON 














PENNSYLVANIA 


X 


X 


X 








RltODE ISLAND 


X 


X 










SOUTH CAROLINA 


X 


X 


X 








SOUTH DAKOTA 


X 


X 


X 








TEXAS 


X 


X 










UTAH 


X 




X 








VERMONT 


X 












VIRGINIA 


X 


X 










WASHINGTON 


X 


X 


X 








WEST VIRGINIA 




X 


X 








WISCONSIN 


X 


X 


X 








WYOMING 


X 


A 










-id 


39 


19 


5 
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aimed at persons involved in the educational process— administrators 
and perhaps teachers— but involved citizens would also find the docu- 
ments of interest. 

The third type of document we received were publications stating 
specific educational objectives, generally perfomance objectives. These 
documents seem to be directed toward local administrators, curriculum 
planners, and, in some instances, classroom teachers. Because few r/cates 
have specified educational objectives, we received few such documents. 

Prom state publications and interview responses we identified 12 
states that have some sort of accountability model. These states are 
Alaska, Arizona, California, Delaware, Kansas, Maine, Michigan, Minnesota, 
Nevada, Ohio, West Virginia, and Wisconsin. The models v«try consider- 
ably in nature and purpose. West Virginia has a very extensive process 
model, showing the steps the state will take in educational assessment. 
Kansas, on the other hand, has a model which specifies responsibility in 
terms of personnel—who is accountable to whom for what. In addition 
to the 12 states with models, nine states refer to some type of "long- 
range plan" in their accountability programs, but our information on 
these plans is too incomplete to amalyze. 

4.8 Nee ds Assessment— Testing; What Are States Testing? 

Because many states are presently involved in student testing ac- 
tivities as part of their accountability programs, we compiled our data 
plus that presented in the ETS report to determine the nature and extent 
of testing activities. We first identified the subject areas being 
assessed, then tabulated the nuxriber of states having assessment pro- 
grams in those areas. This information is shown in Table 12 on the 
next page. 

Ti\e data show that reading and mathematics are by far the most com- 
monly tested subject areas. Respondents in the interviews often men- 
tioned reading and mathematics as the priority areas in their states' 
educational endeavors. Only about one-fourth of the 48 states in the 
survey do any testing of social science/social studies, so social stud- 
ies is definitely not a high priority subject area in needs assessment 
testing programs. More details on the status of social studies in the 
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Table 12. Subject Areas Tested in Student Testing Programs 



- 

Subject Area 


Number of States 
Testing the Area 


Cognitive Areas 




Reading 


40 


Mathematics 


33 


English 


16 


Natural Science 


14 


Social Science or Social Stupes 


11 


Writing * 


8 


Aptitude 


8 


Career- Vocationfld Knowledge 


7 


Noncognitive Areas 




Attitudes 


10 


Citizenship 


9 


Self-Concept 


8 


Physical Fitness 


4 


Values 


3 



general accountability movement are presented in Table 15 > 

To determine how many subject areas are being tested by individual 
states r a second tabulation wets coiqpleted and the results are shown in 
Table 13 on the following page# Of the states with testing programs, most 
are testing fewer than five subject areas. Table 13 also shows t:hat seven 
states presently have no testing program. 

Our analysis of the student testing programs being conducted in vari- 
ous states does not attempt to determine the extensiveness of the testing 
programs or the grade levels of the students being tested. However, from 
survey responses and a review of state documents, it is clear that testing 
programs vary greatly. Some states are testing only selected samples of 
students; other states are involved in testing every student. Some states 
have detailed plans for rotating the testing of subject areas over a per- 
iod of years; other states have only sketchy outlines for testing activi- 
ties. While student testing is the most common activity in state accounta- 
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Table 13* Number of subject Areas Included in Testing 
Program 



Number of Subject Areas 
Being Tested within a State 


Number of States 


11 


1 


9 


1 


8 


3 


7 


3 


6 


5 


5. 


2 


4 


6 


3 


7 


2 


8 


1 


5 


0 


7 



bility programs, there is little similarity from state to state in test- 
ing procedures. 

4.9 Status of Social Studies in Accountability Programs: How Is 
Social Studios Faring in the Accountability Movement? 

Working from what we learned about general accountability pro- 
grams in the various states, we then sought to determine the status of 
social studies within the general accountability movement. In analyzing 
social studies accountability activities, we relied primarily on the 
responses given by the social studies specialists who participated in 
our survey. 

Table 14, on the following page, clearly demonstrates that there 
is little social studies activity within state accountability programs. 
The respondents from the four states which have determined desired out- 
comes for social studies indicated their goals are quite broad; the same 
is true for the educational objectives specified by five states. Repre- 
sentatives from seven states reported that their states are developing 
curriculum guidelines for social studies, which might become part of an 
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Table 14. Steps Taken in Social Studies Within Accountability 
Prograns 



Step'xor Steps Taken (as defined by model) 


Number of States 


u^j-iu^«*^u u%so^^vs\Ji VJwluCv^uico VS^€Ci£iCa>LXy 

for social studies) 


2 


Conducted Needs Assessment Testing 
(conpleted or in progress) 


11 


Specified Educational Objectives 


3^ 


Determined Outcomes and Specified Objectives 


2 


No Activity in Social Studies 


30 



accountability thrust in social studies. 

Table 15, on the following page, has been prepared to summarize vis- 
ually the status of social studies within the overall accountability pro- 
grams operating in the states. General accountability activities are 
shown with one X. General accountability ac^'.vities accompanied by speci- 
fic sociaLL studies activities are shown by a double X. 
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BEST COPY AVAILABU 



r.iiA*! I*.: .'i'fliTiar/ of rinij^ixr-s Ac^l VU;i':l> Within 

Accountability Programs 





Determined or 
De termini x^cj 
Desired Outcomes 
(Goals) 


Conducted or 
Conducting 
Needs Assessment 
(Testing) 


Conducted or 
Conducting 
Needs Assessment 
(Survey) 


Specified or 
Specifying 
Kducational 
Objectives 


ALABAMA 




X 




XX 


AIASKA 


XX 




X 




ARIZONA 




X 






ARKANSAS 




XX 






CAI.IWRNIA 




X 






an.OHADO 


X 


XX 






CONNECTICUT 


X 




X 




DKLAWARE 




X 






FLORIDA 


X- 


X 






GEORGIA 


X 


* X 


X 




HAWAII 


X 


XX 






1 

j IDAHO 


X 


XX 






j INDIANA 


X 


X 






j IOWA 




X 






1 KANSAS 


X 


X 


X 




} KENTUCKY 


X 


X 


X 


X 


j LOUISIANA 


X 


X 






j MAINE 


X 


X 




XX 


■ MARYLAND 


X 


X 






MASSACHUSETTS 


X 


X 


X 




. MICHIGAN 


X 


X 


X 


XX 


MINNESOTA 


X 


X 






Mississippi 


X 


X 






MISSOURI 


XX 




X 


XX 


MONTANA 


X 








NFORASKA 


X 


X 


X 




NEVADA 


X 


X 






NEW HAMPSHIRE 




XX 






NEW JERSEY 


X 


X 


X 




NEW MEXICO 


X 


XX 






NEW YORK 


X 


X 






NORTH CAROLINA 


X 


X 






NOPTH DAKOTA 




X 






OHIO 






X 




OKLAHOMA 


X 




X 




i 

OREGON 










PENNSYLVANIA 


X 


XX 


X 




RHODE ISLAND 


X 


X 






SOUTH CAROLINA 


X 


XX 


X 




SOUTH DAKOTA 


X 


XX 


X 




TEXAS 


X 


X 






UTAH 


XX 




X 




VERMONT 


y. 








VIRGINIA 


X 


XX 






WASHINGTON 


X 


X 


X 




WEST VIRGINIA 




XX 


X 




WISCaJSIN 


X 


X 


X 




WYOMING 


X 


X 
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Table 15 shows that social studies is not receiving much attention 
in overall accountability programs. In our interviews we asked the evalu- 
ation and social studies specialists why social studies seemed to receive 
less attention than other subject areas. Table 16 reflects the answers of 
those who responded. 



Table 16. Why Social Studies Receives 
in Accouixtability Programs 


Little Attention 


Reasons Given by Specietlists 


number of States 


Social studies is not a priority area 


26 


Social studies is too difficult to measure 


7 



Representatives from the 15 states not included in Table 16 indicated in 
response to a previous question that social studies in their states is 
progressing at the same rate as other subject areas in their accountabil- 
ity programs. In :3ome instances that might mean that no activity in a-*y 
area is underway; in others it might mean that social studies is present- 
ly being tested or is included in a long-range accountability plan. 

TO help us project the immediate future of social studies in the 
accountability mov^^nt, our survey participants were asked to indicate 
the next step their state plane to take in social studies accountability. 
Table 17 shows their responses. 

Table 17. Next Step in Social Studies Accountability 



Next Step as Indicated by Respondent Ntamber of States 

Conduct Needs Assessment (Testing) 15 

Develop Social Studies Curriculrmi Plans 

(Program Development) 11 

Specify Educational Objectives 8 

Detemdne Desired Outcomes 4 

No Future Plans in Social Studies 10 
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According to the responses given in our survey, the next step 
most states will take in social studies is to include the subject in 
a testing program. In the instances where respondents indicated their 
state's next step would be curriculum development, they seemed to be 
referring to some type of program development, perhaps curriculum guide- 
lines. Many respondents were not certain if such activity would re- 
late specifically to accountability procedures. The interviewees who 
indicated their states would next specify educational objectives were 
generally referring to performance objectives. 

Table 18 on the following two pages hau3 been prepared to sinnmar- 
ize the present and predicted future status of social studies account- 
ability in the 48 states participating in the survey. By reading ' across 
the page, the completed or in-progress activities in each state can be 
compared to the projected activities for the state. 
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Table 18: Summary of Present and Planned Future Social Studies 
Accountability Activities 



ALABAMA 

ALASKA 

ARIZONA 

ARKANSAS 

CAHFOR^:IA 

COLORADO 

CONNECTICUT 

DELAWARE 

FLORIDA 

GEORGIA 

HAWAII 

IDAHO 

INDIANA 

IOWA 

KANSAS 

KENTUCKY 

LOUISIANA 

MAINE 

MARYLAl^D 

MASSACHUSEll'S 

MICHIGAN 

MINNESOTA 

MISSISSIPPI 

MISSOURI 

MONTANA 

NEBRASKA 

NEVADA 

NEW HAMPSHIRE 

NEW JERSEY 

NEW MEXICO 

NEW YORK 

NORTH CAROLINA 

NORTH DAKOTA 

OHIO 

OKLAHOMA 

OREGON 

PENNSYLVANIA 

RHOrE ISLAND 

SOUTH CAPOLINA 

SOUTH DAKOTA 

TEXAS 

UTAH 

VERMONT 

VIRGINIA 

WASHINGTON 

WEST VIRGINIA 

WISCONSIN 

WYOMING 



Activities Completed or in Progress 



Determined or j Conducted or 
Dete Tianing | Conducting 
Desire tcomes Keeds Assessment 
iGoalsJ I (Testing) 



Specified or 
Specifying 
Educational 



if, 
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Table 18: Sunnary of Present and Planned Future Social Studies 
Accountability Activities 



ERJC 



ALABAMA 

ALASKA 

ARIZONA 

ARKANSAS 

CALIFORNIA 

COIjORADO 

CONNECTICUT 

CELAWARE 

FLORIDA 

GEORGIA 

HAWAII 

IDAHO 

iNDIAr.'A 

IOWA 

KANSAS 

KENTUCKY 

LOUISIANA 

^INE 

DRYLAND 

MASSACHUSETTS 

MICHIGAN 

MINNESOTA 

MISSISSIPPI 

MISSOURI 

MONTANA 

NEBRASKA 

NEVADA 

NEW HAMPSHIKE 
NEW JERSEY 
NEW MEXICO 
NEW YORK 
NORTH CAROLINA 
NORTH DAKOTA 
OHIO 

OKLAHOMA 
OREGON 

PENNSYLVANIA 

miODE ISLAND 

SOUTH CAROLINA 

SOUTH DAKOTA 

TEXAS 

UTAH 

VERMONT 

VIRGINIA 

WASHINGTON 
WEST VIRGINIA 

WISCONSIN 

WYOMING 



Planned Future Activities 



Determine 
Desired Outcomes 
(Goals) 



Conduct Needs 
Assessment 
(Testing) 



Specify 
Educational 
Objectives 



Develop 
Curriculum 



NO 

Stated 
Plans 



moss 
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4>10 Present Scaices of Pressure for Accountability: who Is Pushing 
for Accountability? 

The participants in the survey were asked to identify the major source 
or sources of pressure for educational accountability in their states. 
Responses are shown in Table 19. 



Table 19. Present Sourcos of Pressure for Accountability 



Pressuring Sources 


Number of States 


Single Source of Pressure - - 




Legislature 


12 


State Department of Education 


6 


Citizen Group 


5 


Coinbi:ied Sources of Pressure 




Legislature and Citizen Group 


5 


Legislature and State Department of Education 


3 


Other 




School District Administrators 


1 


School Boards Association 


1 


No Pressuring Sources 


15 



Perhaps the most striking information in Table 19 is that representa- 
tives of 15 states — approximately one-third of our participants — feel 
there are no sources pressuring for accountability in their states. Among 
those 33 states in which representatives identify sources pressuring for 
accountability, nearly one-half (20) point to their legislatures as an 
important source of pressure. State departments of education were identi- 
fied as pressuring sour::es in nine states and citizen groups in ten. 

We were interested to know if the states presently feeling pressure 
by legislatures for accountability are the states which already have en- 
acted legislation. An examination of enacted legislation and legislative 
pressures within states is presented in Table 20 on the next page. 

Table 20 indicates that of the 17 states presently having accounta- 
bility legislation on the books, seven feel continuing legislative pres- 
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Table 20. Accountability Legislation and Pressure by 
Lesiglatures for Accountability 



Legislation and Pressure by Legislatures Number of States 
Has Legislation — Feels Legislative Pressure: 7 
Has Legislation — Feels No Legislative Pressure 10 
Has No Legislation- ' ^e.^js Legislative Pressure 13 
Has No Lagislation—F No Legislative Pressure 18 



sure for accountability whiU " other ten no longer feel such pressure. 
Thirteen of the 20 state«=* ^resencly feeling legislative pressure have no 
enacted legislation relating to accountability. Our data indicate no 
evidence that legislatures- who enact legislation tend to continue their 
press for accountability; conversely legislatures who pressure for ac- 
countability do not necessarily enact legislation. 

4.11 Impact of Accountability on Funds Allocation; Is Funding Tied 
to Accountability? 

In our questions to interviewees about their needs assessment pro- 
grams, we asked if such programs affected the allocation of funds. We 
were also interested in fiscal components of the broad accountability 
programs which respondents described in answering questions about the 
present picture of .-^oountability and the future of accountability in 
their states. Fran information obtained in answers to these questions, 
Tj3le 21, on the following page, was prepared. 

With 32 states reporting that accountability has no impact on 
their funding, it appears that a strong financial component is lacking 
in most accountability programs. The states which use results of their 
needs assessment activity to appropriate funds are doing so mainly to 
provide extra Lundi, for school districts that are shown to need compen- 
satory programs, in informal comnents, many respondents indicated their 
states chose not to publish a district-by-district or school-by-school 
breakdown of needs assessment results because they feared offending the 
citizenry of some school areas. So allocation of extra funding, when 
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Table 21. Impact of Accountability on Funds Allocation 



U se of Accountability Results in Funding 



Number of states 



Needs assessment results used in allocating 
funds for compensatory education programs 



8 



Heeds assessment results used to secure and 
appropriate federed funds 



8 



Accountability activities not affecting funds 
allocation 



32 



State is considering relating funds allocation 
to accountability in the future 



11 



based on needs assessn.ent results, is usually done without much fanfare. 

Table 21 shows that 11 states are considering tying funds allocation 
to accountability results in the future, although roost discussion is still 
in preliminary stages. Respondents from six states — Arizona, Indiana, 
Michigan, New Jersey, Rhode Island, and South Carolina — spoke of coinpre- 
hensive planning to integrate fiscal and program accountability. 

In states which relate funding to program aspects of accountability, 
the fiscal considerations usually become effective in the designing of 
educational programs. For example,- the results of needs assessment acti- 
vities are used to award extra funding for compensatory programs. Our 
accountability model shows this relationship with the connecting line 
between step C and step 5. 

4.12 Future Responsibility for Accountability; Who Will Take the Lead 
in Account^Q3ility? 

The participants in our telephone interviews were asked to predict 
who would tcike ti e future responsibility for educational accountability 
in their states. Table 22 on the following page reflects their responses. 

Participants in our survey feel that local educators will take (or 
be given) the major responsibility for accountability in the future. In 
discussing future plans such as 3pecifying educational objectives or 
designing programs, the respondent often stated they felt such activi- 
ties must be the responsibility of local school districts. 
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Table 22. Future Responsibility in Accountability 



Agents Taking Responsibility Number of States 

Local educators 

16 

State department of education personnel iq 

Joint effort of local and state department 
personnel 

Undecided or unclear 



4.13 Conclusion 

An effort to pull together the extensive and varied data acquired 
through open-ended questioning in our survey is risky, but a few con- 
clusions seem justified. 

First, it is clear that most states presently have some type of 
accountability program or are engaged in activities which will become 
part of an accountability program. However, the nature, credibility, 
and direction of accountability programs vary substantially, and it is 
difficult to identify trends in the programs. 

States having accountability programs seem to be in the very early 
stages of their work. Accountability activities center on goal setting, 
needs assessment testing, and to a lesser extent, needs assessment sur- 
veys. Student testing seems to be the most prevalent and engaging 
activity at present, with a majority of states involved in testing to 
some degree. At this time most states are not tying funds allocation 
to accountability activities. 

The procedures followed by states in their accountability acti- 
vities are diverse. The beginning accountability steps (the only steps 
taken by states to date) in our model proceed as follows: 
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Figure 3* An Accountability Model (Partial) 



(A-1) SDUCATIONAL CONSTITUENCY 
Parents f Students ^ Teachers , 
Voters f Legislators, Admin- 
istratorSf etc> 



\ 



(2) Determining 

DESIRED OUTCOMES 



(3) Specifying 
EDUCATIONAL 
OBJECTIVES 



\ 



\ 



4^ 




(4a) Surveying 

CITIZEN OPIINION 


j" (4) Conducting 

i NEEDS 

1 ASSESSMENT 








(4b) Measuring 

STATUS OF LEARN- 
ERS (Testing) 



Our data indicate that most states axe concerned with most of the elements 
in this particd model , but in veurying sequences. The most common sequences 
are shown in FiguFes 4 emd 5* 

Ficnare 4. Second Accountability Model 
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(A-l) ^DUCATIONAIi CONSTITUENCY 
Parents^ Students^ Teacliers^ 
VoterSf Legislators^ Admin- 
iatrators^ etc> 



(2) 


Determining 
DESIRED OUTCOMES 






(3) 


Conducting 
NEEDS 

ASSESSMENT 






(4) 


Specifying 

EDUCATIONAL 

OBJECTIVES 




(3a) Surveying 

CITIZEN OPINION 




-(3b) Measuring 

STATUS OF LEARN- 
ERS (Testing) 
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Figure 5* Third Accoiintability Model 



(A-1) EDUCATIONAL CONSTITUENCY 
Parents, Students, Teachers, 
Voters, Legislators, Admin- 
istrators, etc> 



■>- 

(2) 


— — - J 

Conducting 

NEEDS 

ASSESSMENT 


N 


/ 


(3) 


Determining 
DESIRED OUTCOMES 


N 


/ 


(4) 


Specifying 

EDUCATIONAL 

OBJECTIVES 




(2a} 


Surveying 




CITIZEN OPINION 




(2b) 


MeMuring 




STATUS OF LEARN- 




ERS (Testinq) 



The only difference between our conceptualization and the procedure 
reflected in Figure 4 is the point in the system at which educational ob- 
jectives are specified. In our developmental thinking, we concludad it 
would be important to specify objectives before assessing needs because 
such objectives could serve as standards for evaluating the results of 
needs assessments. However, from both Figures 2 and 5 it seems that 
in actuality irost states are specifying objectives after assessing needs. 

Coir«)aring our model with Figure a, a second difference appears. 
States following the model of Figure 5 are beginning with a needs assess- 
ment step and using the results of that activity to determine desired 
outcomes. As noied previously, one explanation of this procedure may be 
that many states had initiated needs assessment (particularly student 
testing) activities before accountability became an issue; therefore 
they have decided to start their accountability programs with activ- 
ities already in progress. 

As for social studies, the involvement of the subject area in the 
total accountability movement is limited. Only 18 states include soc- 
ial studies in their present accountability programs, and many survey 
respondents indicated that social studies is not a priority area in 
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their present or projected accountability activity. 

The future of general accountability is unpredictable from our data. 
Thou^ there are definitely sources pressuring for accountability in cer- 
tain states, our information does not reflect a strong, nationwide push 
for accountability. If the respondents in our survey are predicting the 
future accurately, educational accountability, in its many forms, will 
be left largely to local educators. It seems likely that local-district 
accountability efforts would result in even more varied approaches than 
is true of the state-level activities surveyed in this study. 
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Survey Participants 



ERIC 



Alabama 

Russell Berry, Chief consultant, Social Studies 
Ledford Boone, Coordinator, Planning and Evaluation 
Alaska 

Paul Hilburn, Section Chief, Secondary Education 
Mary Lou Madden, Research Analyst in Planning and. Research 
Arizona 

Mary Jo Livix, Deputy Associate Sxaperintendent 
Bill Raiinond, Director, Planning and Evalxiation 
Arkansas 

David Price, Social Studies Specialist 

Sherman Peterson, Associate Director, Plimning and Evaluation 

California 

Ruth Franch, Consultant in Education 

Alex Law, Chief, Office of Evaluation and Research 

Colorado 

Calvin Anderson, Director, Supporting Services 
Jim Hennes, consultant in Planning and Evaluation 
Connecticut 

Arthur Soderlind, Social Studies Consultant 
George Kinkade, Chief, Bureau of Evaluation 
Delaware 

Donald Knouse, Supervisor of Social Studies 
Wilmer Wise, Director, Planning, Research, and Evaluation 
Florida 

Patricia F. Spears, Social Studies constdtant 
Crane Walker, Director, Educational Accountability 
Georgia 

Gwen Hutcheson, Social Science Service Consultant 
Lester Solomon, Coordinator of Program Development 



Hawaii 



Elaine Takenaka, Social Studies Specialist 
Paul Gimar Task Specialist Evaluator 

53 



54 



Idaho 

Sara Fowler, Consultant for Con5>ensatory Education 
Wayne Phillij.;, Program Administrator, Planning and Evaluation 
Indiana 

John Harrold, Social Studies consultiuit 

Ivan Wagner, Director, State Planning and Evaluation 

lov/a 

'■-LChard Gage, Consultant for Social Studies 
Max Morrison, Director of Planning^ Evaluation, and Research 
Kansas 

Richard Leighty, Social Studies Specialist 
John Hunter, Director, Planning, P^esearch, and Evaluation 
Kentucky 

Anthony Koester, Social Studies Consultant 
Donald Van Fleet, Director, Division of Evaluation 
Louisiana 

Louis Nicolosi, Supervisor of Social Studies 
Everett Woerster, Coordinator, Needs Assessment 

Mctine 

Joseph Peccraro, Educational. Planner 

Horace P. Maxcy, Jr., Assistant to Commissioner of Education 
Maryland 

James Addy, Social Studies Specialist 
Frank Mclntyre, State Coordinator for Accountability 
Massachusetts 

Thomas Donahue/ Senior Supervisor in Education 

James Baker, Director, Division of Research, Planning and Evaluation 
Michigan 

Robert ^rezise. Social Studies Specialist 

David Donovan, Director, Research, Evaluation, and Assessment Services 
Minnesota 

Boger K. Wangen, Social Studies Consultant 
John Adams, Director, State Educational Assessment Program 
Mississipp i 

Rebecca Taylor, Elementary Social Studies. Consultant 

Jerry Hutcheson, Coordinator, Office of Planning and Evaluation 
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Missouri 

Richard King, Coordinator of Curriculian 
John Allan, Chairtnan, State Assessment Project 
Montana 

Edward Eschler, Assistant Director for Basic Skills 

Robert Lehman, Director, Research, Planning, Development, and 
Evaluation Unit 

Nebraska 

Joseph Mara/ State Consultant to Plauining, Research, and Evalua- 
tion Division 

Thomas Wadsh- Consultant to Planning, Research, and Evaluation 
Division 

Nevada 

Jim Bean, Social Studies Consultant 

James Kiley, Associate Superintendent, Planning and Evaluation 

New Hampshire 

Carter Hart, Consultant for Social Studies Education 
H. Stuart Pickard, Director, Research and Development 

New Jersey 

James Van Zoeren, Coordinator for Middle Schools 

Gordon Ascher, Deputy Assistant Commissioner, Division of Research, 
Planning, and Evaluation 

New Mexico 

Joe Thonpson, Director, Social Studies Division 

Robert Stewart, Assistant to Director of Statewide Evaluation, 
Assessment, and Testing Unit 

New York 

Donald Bragaw, Chief, Bureau of Social Studies Education 

Gerald Freeborn, Assisteuit Commissioner for Long--Range Planning 
North Carolina 

Mary Vann Wilkins, Social Studies Consultant 

Robert Evans, Director of Evaluation 
North Dakota 

Lynn Davidson, Director of Curriculum Develofsnent 

Lowell Jensen, Director, Division of Planning and Development 

Ohio 

Byron Walker, Consultant for Social Studies and Humanities 

John Adams, Chief of Planning, Division of Planning and Evaluation 
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Oklahoma 

Charles stone, Specialist for Social Studies 
James Casey, Coordinator, Planning, Evaluation, and Research 
Oregon 

Al Grubb, Acting Director of Social Relations Section 

R. B. cleniner. Coordinator, Planning and Evaluation 
Pennsylvania 

Robert Schell, Social Studies Advisor 

Thomas Kendig^ chief. Division for Educational Quality 
Rhode Island 

H. Wells French, Humanities consultant 

Nelson Ashline, Associate Commissioner of Education 

Carol Kominski, State Testing Consultcint 

Henry Stevenson, Research, Master Planning and Evaluat-ion 
South Carolina 

A. Moseley, Social Studies Consultant 

W» Edward Ellis, Director, Office of Research 
South Dakota 

Henry Kosters, Assistant Superintendent 

Texas 

Leroy Psencik, Program Director for Social Studies 
Richard S, Haxdeback, Acting Program Director, Evaluation 

Utah 

Allen Bauer, Specialist for Social Studies 
Don Richards, Director, Utah Planning Unit 
Vermont 

Donn McCafferty, Chief, Secondary Education 
Robert Withey, Commissioner of Education 
Virginia 

James Bagby, Supervisor of Testing 
Clyde Haddock, Assistant Supervisor 
Washington 

George Whitney, Supervisor of Social Studies 
Alfred Rasp, Director, Program Evaluation 
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West Virginia 

Jack Newhouse, Program Specialist for Social Studies 
Douglas Machesney, Assistant Superintendent, Planning and Evaluation 
Wisconsin 

Russell Moseley, Social Studies Specialist 

James Gold, Assessment Coordinator, Department of Research, Evalua- 
tion, mid Assessment 

Wyoming 

Joey Windham, Coordinator for Social Studies 

Mary Sandifer, Director, Planning, Evaluation, Research Unit 



Survey Questionnaire It Social Studies Personnel 



I. How is the 'tecount ability movement affecting social studies in your 
state? 

- If not affecting social studies, why .not? (just reading, math?) 

A. What is the role of the State Department of Education in account- 
ability? (from responsibility for statewide accountability pro- 
grams to nominal suH)ort for a variety of school improvements) 

E. Who in your state is pushing for increased accountability? 

1) What form are these .pressures taking? 

2) How is the state department of education responding? 

C. How are goals set in social studies education in your state? 

11 Who is involved in goal setting? 

2) How does goal setting process work? 

3) Is there a pi;±>lished statement of goals? 

4) Are ao&ls binding on local districts? 

5) How are state goals tied to local goals? 

6) Is there a distinction made between goals eind objectives? 

a. Dogs the state spell out objectives? (goads — vague, 
ganeral, public involved; objective^ —demonstrate level 
of a particular skill, set by educators) 

7) Does your state provide curriculum materials to meet these 
goals? 

8) Are they mandatory? 

Is tr*e.r«. a state assessment program? 

1) What kind is it? (stand2u:dized test, etc.) 

2) What use is made of the results? 

a. Are they distributed? If so, how? 

b. Do results affect: funds allocation? piablic pressure? 
reso?irce allocation? 

E. What do you see yours'ilf accountable for as the state representa- 
tive in social studies? 

II. Future 

A. What do you see for the future in your state social studies 
accountability? 

B. Do you see the state's direction in accountability as providing 
opportiAnity or getting results? 

C. Is the move toward a statewide plan or emphasis on local respon- 
sibility and development? (state effort could be supplying re- 
sour ces^ persppiielv workshops.) 
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How does the state plan to accomplish its goals in assessment 
and accountability? 

Ill* Any publications current or planned? 
IV • Who is state person in charge of evaluation/accountability programs? 
V. Anything of interest we haven't covered? 
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Survey Questionnaire 2; Evaluation Personnel 



1. Can you give rae an overall picture of the accountability movement 
m your state? 

A. What is the role of the state department of education in th'=^' 
accountability movement? (along a continuum of having major 
responsibility for develoixnent and implementation to playing 
a minimal, supportive roie) 

How has it been decided what the state department's role shall 
be? (e.g., legislature has mandated, in Constitution, state 
superintendent has taken initiative, etc.) 

C. Who in the state is pushing for increased accountability? 
(e.g., legislature, citizens groups, teachers association, 

1) What form are these pressures taking? 

2) How is the state department of education responding? 

II* Within the state department, what is your role as the evaluation 
specialist in relation to accountability? 

A. Have evaluation specialists taken the main leadership in 
designing and implementing the program? If not, who has? 

B. What is your relationship to the curriculum prK)ple (generalists 
or specialists) in the state department regarding accountability? 

III. What jjnpact is accountability having on' the wcial studies program 
in your state? 

A. If social studies is not yet involved, why not? (reaction of 
social studies people. in the state? lack of instrument (s)? 
unclear goals?) 

B. Since mos-c accountability relates to goals, can you tell me 
anything about how the goals are set in social studies education 
in your state? 

1) Who is involved? (citizens, teachers, students, department 
of education persons, etc.) 

2) Hov; does the process work? 

3) Is goal setting based on any kind of needs assessment? 

4) Is Uiere a published statement of goals? 
a. What is the title? 

5) Are state goals binding on local districts? 

6) If not, how are state goals tied to local goals? 

7) Does the state spell out specific objectives in relation 
to these goals? 

C. Does the state provide curriculum materials such as textbooks and 
curriculum guides to meet these goals in social studies education? 

60 
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1) Are they mandatory? In other words, to what extent does 
the state prescribe how schools shall go about meeting 
these goals? 

D. Is there a state assessment program in social studies? 

1) If there is no state assessment in social studies, why not? 

2) If there is no state, assessment in social studies, are there 
local assessment programs? 

3) If so, what kind is it? (National Assessment or modifica- 
tion? developed own instnament (s) ?) 

4) Who is responsible for selecting and/or designing the state 
assessment instrument ? 

5) If there is a state eissessment progrcon, what xise is made 

of the results? (e.g., for state and local decision making?) 

a. To whom are the results distributed? (state superinten- 
dent, legislature, the public?) 

b. How are they distributed? (through newspaper, confi- 
dential report, special publication, to districts?) 

c. Do results affect: funds allocation (to help or pun- 
ish)? public pressure? resource allocation? 

IV. Future 

A. Vlhat do you see for the future in your state regarding accounta- 
bility? 

1. Is the move toward a statewide plan or toward emphasis 
on local responsibility and development? (State effort 
could be supplying resources, personnel, workshops.) 

B. What do you see for the future in your state regarding social 
studies accountability? 

Do you have any pointers or helpful information to share with 
others who are just beginning an accountability program? 

Does your state have any publications, current or planned, that 
describe your accountability or assessment prograno goals or 
objectives, or program design? If so, we would like to have 
them, not only for use in this study but to put into the ERIC 
system. 



V. 
VI. 
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Accoimt ability Conference Pgurtlclpants 



December 1973 Boulder, Colorado 



Christine Ahrens - Editor, ERIC Clearinghouse for Social Studies/Social 
Science Education 

Joanne Binkley - Assistant Director, ERIC Clearinghouse for Social 
Studies/Social Science Education 

Paul Bradley - Associate Professor, Division of Foundations and Research 
Methods, School of Education, University of Colorado 

Katherine DePew - Consultant, District Planning and Accountabili1:y Ser- 
vices, Office of Field Services, Colorado Department of Education 

Robert Fox - Director, ERIC Clearinghouse for Social Studies/Social Science 
Education 

Karen Friedman - Writer, ERIC Clearinghouse for Social Studies/Social Sci- 
ence Education 

Richard Hardebeck • Acting Director, Evaluation, Texas Education Agency 

Michael Hartoonian - Social Studies Specialist, Wisconsin State Depart- 
ment of Public Instruction 

Irving Morrissett - Associate Director, ERIC Clearinghouse for Social 
Studies/Social Science Education 

Arthur Olson - Director, Project Operations Board, Cooperative Accounta- 
bility Projectf Denver, Colorado 

Patricia Spears Social Studies Consultant, Florida Department of Edu- 
cation 

Robert Trezise - Social Studies Specialist, Michigan State Department of 
Education - 

Ivan Wagner - Director for State Planning and Evaluation, Indiana State 
Department of Education 

Frank Woraer - Staff Director, National Assessment of Educational Progress: 
A Project of the Education Commission of the States, Ann Arbor, 
Michigan 
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CHART 3 State and Local Participation in Accountability Activities 

at the State and Local Levels « 







DETERMINING DESIRED 


OUTCOMES - 




State 


State sets 
state Roals 


State and locals 
set state goals 


State helps locals 
with local coals 


Locals set 
local soals 






J 












SPIXIFYLKG EDUCATIONAI, OBJECTIVES 


State 


State sets 
state 

obioccives 


State and locals 
set state(d.de 
objectives 


State helps locals 
with local 
obiectives 


Locals set 
local 

objectives 
















MIii\SURIN'G S'mVS Ov ],E/\R:N1:RS 


State 


State directs 

statewide 

measurcmonc 


St'-ite and locals 
direct state\/ide 
mcasuroincnt: 


State helps locals 
with local 
mensii rement 


Locals dii'ect 
local 

measurcmonc 


















DKSIC;X£NG I-DUCATIOM-Vl. PROGRAM 


State 


State dejLf,n3 
state proi;ram 


State and locals 
design state 
proj:rain 


State helps locals 
desi(*n local 
prop, rain 


Locals design 
local proj;ram 













*• Insufficient inforaationj .cannot record state and/or local activity. 



APPENDIX B 



Informal Reports from State Department Personnel Concerning 
Accountability and the Social Studies: 

Michigan: Robert L. Trez^se 
Wisconsin: H. Michael Hartoonian 
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ACCOUNTABILITY IN SOCIAL STUDIES IN MICHIGAN 

by 

Robert L» Trezise 
Curriculum Specialist 
Michigam Depaurtaent of Education 
Lansing, Michigan 

The word accountability is, it seems to me, almost a meaningless 
term unless one takes the time to define it specifically. To some peo- 
ple, accountability is synonymous with state assessment programs, while 
to others it seems simply to be a code word for blaming teachers for 
whatever their students. do not achieve. 

In Michigan we have defined the word accountability in terms of an 
Accountability Process Model: each word in that phrase is significant. 
The word Process suggests that accountability is a dynamic, action- 
centered concept—a management technique, if you will. Thus, accounta- 
bility ia Michigan is more verb than noun. Also, the word Model is im- 
portant in the phrase because we in the Michigan Department of Education 
believe that the Accountability Process, as we have defined it, can and 
should function as a model for educators throughout the state, at what- 
ever level or in whatever program they happen to be working. We in the 
Department atteir5)t to apply the Accountability Process to virtually every- 
thing we do, and we think the Process cem be applied as well by people 
at the local district level, or by staffs in particular school buildings, 
or even by an individual teacher who wishes to pursue a program of ac- 
countability on his or her own* In other words, the Michigan Accounta- 
bility Model, we think, has very wide applicability—as a good model 
should. 

The Accountability Model developed in Michigan is a six-step process. 
The" first step is identifying goals—the long-range purposes of program. 
What, over an extended period, would you like programs to achieve for 
students? The second step is translating the goals into specific stu- 
dent performance objectives: unless broad goal statements are further 
defined in terms of specific objectives, they tend "to gather dust on 
the shelves and have little in5)act on the day-by-day procedures in the 
classrooms. The third step is conducting needs assessments to find out 
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where the students are at present in terms of the objectives that have 
been developed; have the students reached the objectives, or do they have 
a long way to go before they achieve them? The fourth step is developing, 
identifying, or analyzing delivery systems and/or instructional progretms 
that will help students reach the objectives* At this step, the more pro- 
grams identified the better; i.e. the more mecuis teachers have for helping 
students reach defined objectives, the more likely it is that students 
will reach the objectives. The fifth step is evaluating the program to 
find out the extent to which it was successful in helping students achieve 
the objectives. And the sixth step is reviewing all the preceding steps 
and making the changes and revisions that may be necessaary. 

It would be difficult, it seems to me, to argue against this kind of 
six-step process in planning educational programs because the process has 
a certain irrefutable logic that can be applied to all educational endeavor. 
Also, placing the idea of accountability in this process-model mode gets 
away from making accountability simply a way of "placing the blame on teach- 
ers" when their students do not do well. If students are not achieving 
up to expectations, one needs to examine the total delivery system. The 
teacher is only one part of that system. One must consider, too, other 
factors, such as the materials, the instructional strategies in use, the 
role of building principals and the administration generally, the avail- 
ability of inservice opportunities, tlie school board's priorities, and the 
si5)port that the community is willing to give the schools. Holding only 
teachers accountable is, of course, absurd — at lecist in terms of Michigan's 
Accountcd^ility Process Model. 

In brief, when we talk about accountability in Michigcin, we are talk- 
ing about this six-step model, and everything we do in the Department, we 
hope, serves as a demonstration (ais a model) of how the steps cc^n be im- 
plemented* 

In terms of this idea, we have been attempting over the past several 
years to relate the six-step process to each of the subject areas, includ- 
ing social studies. In sociaLL studies, as in all the other curriculum 
areas, we havfe* worked out broad goal statements that may apply to social 
studies programs at the elementary and secondary levels. These goals in- 
dicate in a broad way what students should be able to do and what they 
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should know by the time they finish social studies programs az the early- 
elementary, the later-elementary, and the junior-high school levels. 
These goals, of course, evolved on the basis of input from many, many 
people throughout the state. After developing the goals, we defined 
them~or, in a sense, translated them— into specific performance objec- 
tives. For each goal, one to five specific objectives were developed. 
At the elementary level, 18 social studies goals were defined; at the 
secondary, 49 goals. The topics of the elementary goals are as follows: 

1. Formulating and Justifying Concepts 

2. Making and Testing Generalizations 

3. Gathering Information from a Variety of Sources 

4. Taking Part in Group Discussions 

5. Taking Part in Group Activities 

6. Problem Solving 

7. Feelings, Attitudes, and Values 

8. Services Available to Persons 

9. The World of Work 

10. The Transmittance of Cultural Traits from Person to Person 

11. Adapting Biological Inheritances to the Environment 

12. Comparative Cultures 

13. The Concept of Chamge 

14. Concepts in History 

15. The Nature of Rules and Laws 

16. Economic Choices 

17r Man's Use and Misuse of the Enviroxunent 

18. Map and Globe Reading Skills 

The topics of the secondary goals are: 

1. E3cploring One's Ovm Values 

2. Exploring the Values of Others 

3. Exploring the Attitudes of Others 

4. E:q?loring One's Own Attitudes 

5. Exploring the Feelings of Others 

6. Exploring One's Own Feelings 

7. Rights and Responsibilities 

8. Mature Behavior 

9. Group Discussions 

10. Group Activities 

11. Making and Testing Generalizations 

12. Formulating and Justifying Concepts 

13. Cause and Effect 

14. Making Predictions 

15. Making Inferences 

16. Formulating and Testing Hypotheses 

17. The Nature of the Social Sciences 

18. Analyzing Written Selections 

19. Gathering Data 

20. Cougar ing Data 

21. Identifying the Relevance of Data 
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22 • Problem Identification and Solving Problems 

23. Field and Library Research 

24. Reading and Interpreting Maps, G.^obes, Charts and Graphs 

25. Relationship Between School Activities and the World Outside 
of School 

26. Occupation? 1 Clusters . 

27. Making Career Choices 

28. Respect for Various Occupational Areas 

29. Job Interviews 

30. Geographic Influences on People 

31. Governmental and Political Systems 

32. Constitutional Bases and Functions of Governments 

33. Constitutional, Statutory, and Other Areas of Law 

34. Power 

35. Economic Systems 

36. Consumer Affairs 

37. Insurance Poiicies, Credit Card Agreements, and Loan Agreements 

38. Urban Problems 

39. Environmental Problenc 

40. Historiography 

41. Arts and Humanities 

42. The Concept of Change 

43. Technological Change 

44. Conflict 

45. War and Peace 

46. Comparative Cultures 

47. Contributions of Various Racial and Ethnic Groups to Society 

48. Prejudice and Discriminatory Practices 

49. Leisure Time 

We are now at work on the third step of the process — developing needs 
assessment items that can be \ised to determine student needs in the social 
studies, at least as they exist in terms of the objectives. Eventually if 
school districts (or the state or cm individual teacher) wish to know where 
students are in social studies skills and competencies , they will have 
a pool of assessment items available to them that can help answer this 
question. 

That is a very brief overview of what we have been doing in the De- 
partment of Education in terms of accountability, especially as it relates 
to the social studies. In the rest of the paper I will attempt to relate 
some things we have learned in working out this kind of program. 

First, defining social studies programs in terms of student perform- 
ance objectives is, I believe-, a very worthwhile endeavor. Social stud- 
ies tends to be an ill-defined area of study, and students (and even teach- 
ers) often do not have a clear idea of what a program should be accomplish- 
ing. Defining the broad goais of programs and therTtransidring xh6'se goals 
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into the spare, precise language of performance objectives tends to drive 
the fuzziness out; it forces one into the basic and sonvetimes very dif- 
ficult task of saying exactly what it is we are trying to do with young- 
sters through social studies instruction. There is no escape into 
vagaries when one is writing a performance objective. 

Personally speaking, at first I doubted that^ social studies pro- 
grams could or should be defined in terms of performance objectives. 
Like a lot of other people, I tended to feel that by doing this you would 
kill the heart of the matter. But having been at the task of developing 
objectives for several years now, I am convinced that there is no better 
way to sharpen one's thinking in social studies than to work out pro- 
grams in performance-objective terms. 

Another point i would make is that student performance objectives 
worked out at the state level should be seen mainly as a model for ob- 
jectives being developed at the local level. Everyone, I think, should 
engage in the task of working out performance objectives. Simply to 
take someone else's objectives in toto is much less valuable than writ- 
ing them yourself. But developing objectives is a very difficult and 
time-consuming task, especially in the social studies, and it is well to 
have some basic objectives to act as a framework, a basis, a model. This, 
it seems to me, is a legitimate \ase of social studies objectives developed 
at the state level; state-level objectives can and should serve as a 
guide to educators developing objectives for their own programs or 
classes in terms of local needs. 

If state objectives axe to have any credibility, they must represent 
the thinking of a lot of people in the state— teachers, curriculiom co- 
ordinators, social studies specialists, representatives of the state 
social studies councils, and so on; these people should represent all 
parts of the state and all sizes of school districts. Objectives de- 
veloped at the state level, if they are to be used as a model throughout 
the state, must represent the thinking of scores — and perhaps hundreds— 
of people throughout the state. Perhaps it would be wel]. to involve very 
large numbers of people in getting the initial ideas, the raw material, 
for the goals and then rely on smaller, ^re specialized groups of soc- 
ial studies people for the job of translating the goals into specific 
objectives. Maybe smaller groups yet would be necesssary for the actual 
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writing of the objectives; then undoubtedly large groups would again be 
needed to review the final stages of the drafts. Whatever the process, 
objectives must represent the efforts of many people if they are to serve 
effectively as a state set of model objectives. 

I think, too, that social studies objectives developed at the state * 
level should be seen as minimal—the basics. If a department of education 
attempts to define so-called maximal objectives for a total social studies 
program, it will put a ceiling of sorts on local programs and thereby cre- 
ate many difficulties, in Michigan all objectives, including the social 
studies objectives, are referred to as "minimal student objectives''; rather 
than representing total program objectives, they represent some of the 
skills and competencies students perhaps should attain by the end of the 
third, sixth, and ninth grades. Local districts are thus encouraged to 
go beyond the state objectives, define them on a grade-by- grade basis, 
and develop them in specific content areas. The state objectives should 
be seen as the foundation — not the wall, not the roof, not the trimmings, 
not the interior design. 

And now a point I think is absolutely crucial in developing state 
objectives in the social studies. In Michigan the social studies o*^j ac- 
tives relate to basic social studies skills and basic social studies 
concepts. They do not suggest what content per se should be taught. It 
is up to the local dlAtricts to supply the content—to put the meat on the 
bones. For example, consider the goal "making generalizations," the 11th 
goal at the secondary level. Our objectives suggest that by the end of 
the ninth grade, students should be able to make generalizations on the 
basis of data. (The objective reads, "Given a group or groups of data, 
the student will identify appropriate generalizations on the basis of those 
data, as measured by minimum criteria on an objective-referenced test.") 
That is the skill we hope students will attain. But it is up to the local 
district or the individual teacher to decide what content or what subject 
matter he or she will use to teach to this objective. We do not specify 
the content nor the means of teaching students to generalize. 

To take another example, the 34th secondary goal refers to the con- 
cept of power. By the end of the ninth grade, students should have some 
idea of what the concept of power is all about. (One of the objectives in 
this ^oal area -reads, "Given a description of a social unit or organization, 
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or given a description of various societies, institutions, or nations, 
either pa,st or present, mythical or real, the student will identify 
the persons of power and/or the power structure within that unit . . .**) 
But again, the specific content for teaching to this objective is up 
to the local districts. One teacher may teach to this objective through 
a study of ancient Rome, another (if he's brave enough) through a study 
of current local affairs. 

The idea of including skills and concepts rather than content per 
se in the objectives makes the Michigan objectives somewhat "content 
free"~or at least "content fair." Thia approach is, I think, advisable 
for a number of reasons. First, it preserves local autonomy in that lo- 
cal districts and individual teachers remain free to decide for them- 
selves what specific content they will use with their students. If one 
school wants to teach South America in the .-seventh grade, so be it; if 
another warxts to teach U.S. history, fine. But boQi can use their par- 
ticular conte^iit ':,o teach to the objective of getting students to make 
generalizs^tions and to understand some principles of power. 

Second, if state-level developers attempt to get into specific con- 
tent- objectives, the problem of reaching agreement about what informa- 
tion should be included at particular grade levels becomes almost im- 
possible. Saying that all students everywhere in the state should study 
South America in the eighth grade would be difficult to defend. 

Third,. sticking with conceptji and skills avoids getting into poten- 
tially controversial specific aroas. It is diffxcvlt for anyone to argue 
against the objective of getting students to t^ace cause and effect re- 
lationships or to detect bias in what they read. 

These are some reasons, then, for focusing on skills and concepts 
in state objectives. This is a particularly strong point in a day and 
age when many schools a::e moving towards the mini-course concept. If 
objectives are defined in terras of skixls and concepts, an infinite 
number of mini-courses can teach to those objectives. The skill of 
formulating concepts can, for exairple, be attained in a course on the 
Roaring "20s and the Dirty '303 just as well as in a course on the 
Life and Times of Colonial Fathers. 

We have also learned that it is important to try to write a measure- 
ment device as the objective itself is being developed. If you can't 
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write an assessment item for it, it is not a good objective. In Michigan 
we have developed an exaxaple assessment item for every social studies ob- 
jective. 

Let's take an example. The 40th secondary goal area refers to histor- 
iography — that is, by the end of the 9th grade, students 3>iould have some 
grasp of b'sic principles of the study of history. One of the objectives 
that deal vvith this idea is: "Given a number of accovnts of a partficular 
historical event, either mythical or real# the student will be able to 
choose which account suggests various biases and viewpoints that may be 
held by the authors of those accounts." An assessment approach to this 
objective might be to present the students with three accounts of a parti- 
cular battle. The student would then be aisked to indicate which account 
seems to favor one side, which account seems to favor the other, which 
account seems to be the most objective, which account seems to have been 
written by someone soon after the event occurred, and so on. Presumably, 
the students who had a teacher who taught to this objective over a period 
of time woul^a do better on an item like this them students who had nevei" 
been asked to consider principles oi; historiography. 

Assessment approaches need not be of just the paper-and-pencil test 
varit/cy. Indeed, they should not be only of this vixitage. Objectives may 
also be assessed through actual classroom projects and activities and 
through teacher observation techniques. I think non -paper-and-pencil test 
approaches are especially appropriate to the social studies. 

tty feeling is that social studies should be considered as affective 
as «t is cognitive. Among the topics listed previously, many are in the 
affective domain. In fadt, the first six secondary topics deal directly 
with attitudes, values, and feelings related to both self and others. Foi. 
exan?>le, an objective that relates to the second topic (the values of others) 
reads, "Given a description of a group of people, either mythical or real, 
the student will identify the values probfid^ly held by those people." An 
assessmsnt item that relates to this objettive presents a brief descrip- 
tion of a Sparta-like society; the student is asked to indicate from a 
list those values that seem exemplified by those people. 

The objectives that ifeal with the attitudes, vadues, and feelings 
related to self are strictly in the self-examination cuid clarification 
mold. Hence, one objective in this area states that a student will identify 



75 



from among a group of values those in which he/sho believes, a teacher 
may assess this objective in the classroom by simply observing whether 
a student is willing to take part in a values clarification discussion. 
If a paper-andrpencil test item had to be used, a student could be asked 
to choose from a list of values those she/he believes to be personally 
important. The point is that students make a choice, not that they 
choose one value or the other. Obviously, in regard to items that as- 
sess values objectives, there can be no "correct" answer, at least when 
a student is asked to indicate his own values. 

One problem with state objectives that stress skills and concepts 
is that social studies teachers, as a whole, tend to be content oriented, 
rather thajtiUcill or concept oriented, state objectives that reflect 
this social studies instructional mode do, therefore, tend to reflect 
what might (or should be) in social studies programs rather than what 
is. For years, advocates of the "new social studies" have been at- 
tempting to interest teachers in doing more than purvey content with, 
alas, too little success. B<icause the state objectives tend not to 
reflect the status guo in social studies instruction, they are sometimes 
viewed skeptically by teachers. 

However, as more and more commercial social studies materials move 
toward inquiry approaches, skills, and concepts, and as this approach 
is increasingly stressed in teacher training programs, perhaps changes 
in social studies instruction will occur and more people will accept 
objectives that are in the "new social studies" school of thought. Never- 
theless, if social studies objectives at the state level focus mainly 
on skills and concepts, as I believe they must, then they will not be 
received with equal approval by everybody. But if objectives are not ' 
state mandated, then districts that want to develop social studies -ob-^ 
jectives that relate exclusively to content may do so. ' The important 
thing, after all, is that teachers tl.amselves define social studies 
objectives. 

What about state assessment? In Michigan we do have a state as- 
sessment program, and at present every fourth and seventh g.-ader in the 
state is tested each fall in the areas of mathematics and reading. 
Plans sre to expand state assessment into other grades (probably the 
tenth and twelfth) and into other areas, including the social studies. 
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Since the assessment program in Michigan is criterion-referenced (every 
item on the test relates directly to a state minimal objective) , when the 
assessment program begins to include social studies, the state objectives 
will be the basis for the items on the test. In other words, teachers 
throughout the state will know exactly what social studies objectives will 
be covered on the test. As the state assessment program expands into sub- 
ject areas other than reading and mathematics, however^ these added areas 
will probably be tested on a sampling, rather than an every-student basis. 

Although state assessment of social studies objecti/es is undoubtedly 
more difficult than reading and mathematics objectives^ I feel that it is 
important to include these other areas, if for no other reason than to 
demonstrate that social studies should be considered a basic and essential 
part of the school curriculum. Not to include a particular area in a jtate 
assessment program tacitly suggests that the area is not really important. 
In addition, if a state assessment battery in the social studies were to 
test to skill and concept objectives, this would have a tremendous impact 
on social studies instruction in the state. Perhaps such testing would at 
last tend to move instruction away from a purveying of facts and informa- 
tion and in the direction of teaching to broader concepts and^basic skills* 
When the state assessment program includes social studies objectives, how- 
ever, the objectives will continue to be seen as minimal. Local districts 
will continue to develop objectives beyond the state's minimal ones. 

As previously mentioned, many people naed to be involved in developing 
state objectives. After the objectives have been developed, a great deal of 
effort needs to be expended in explaining and discussing the use of tlie 
objectives with citizens of the state. In Michigan we spend much time in 
both regional and local district workshops discussing how the objectives 
were developed, how they can be implemented in school programs, what in- 
structional programs can be used to teach to the objectives, how they fit 
into the state's idea of accountability, and so on. 

One practical problem ia getting the objectives distributed to every- 
one who wants them. Printing and mailing is very expensive; we have often 
run out of copies and unfortunately not always had sufficient funds to print 
more. If a state plans to use an accountability model that involves pre- 
paring state objectives, it should prepare for the costs involved. 

It will be noted that I refer to "teaching to" the objectiv.as. If ob- 
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jectives are good and legitimate ones, they should be "taught to"; that 
is their reason for being. There is a difference, however, between 
"teaching to" an objective, which is legitimate, and "teaching to" an 
assessment item that measures attainment of that objective; the latter is 
not legitimate. Unfortunately the two are often confused, when teach- 
ers are scandalized by the idea of "teaching to" an objective, they usu- 
• ally are thinking of "teaching to" a test item. 

A few finM thoughts. First, meeting with people and talking with 
them about accountability and objectives is preferable to issuing pub- 
lications, especially if the discussions allow for questions and answers 
and an exchange of ideas. Second, although objectives, because of their 
language, may appear formidable to teachers, they begin to be more ac- " 
ceptable when teachers are given examples of how they can actually work 
in the classroom.. Third, it is also impott-mt for teachers to understand 
that one objective may be approached in many different ways, depending 
on the students' learning styles and the teachers' teaching styles. " 

Finally, state assessment results should be seen simply as data 
that the teacher can put to use in helping to ascertain student needs. 
No state: assessment program can or -should attempt to be an assessment 
of the whole program, any more than stj.::e objectives should be seen as 
the only objectives that should be ased. Just as it is important for 
districts and teachers to develop their own objectives, it is equally 
important for them to develop their own azjsessment programs, state as- 
sessment can provide significant state-wide data that teachers will find 
useful in considering the needs of their own students. But teachers 
will surely want to conduct their own assessments of student needs using 
techniques appropriate to the classroom but not to state assessment 
batteries, which must by necessity be somewhat limited to paper-and- 
pencil approaches. 

These, then, are some thoughts on accountability as they apply to 
the social studies in Mi.chigan. if the reader would be interested in 
seeing the full set of the Michigan objectives, they may be obtained 
by writing to the Department of Education. I would also refer readers 
to an article on developing social studies objectives in Michigan in 
the January 1974 issue of Social Education. . 
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STATE ASSESSMENT AND THE SOCIAL STUDIES: 
• . . WHERE ANGELS FEAR TO TREAD 
by 

H. Michael HartoonicUi 
Social Studies Specialist 
Wisconsin Department of Public Instruction 
Madison, Wisconsin 



In 1971, the Wisconsin state Legislature enacted a law compelling 
the Department of Public Instruction to •'develop an educational assess- 
ment program to measure objectively the adequacy and efficiency of edu- 
cational programs offered by public schools in the state. The programs 
shall include . . . methods by which pupil achievement in fundamental 
course areas . „ . will be objectively measured each year."-'" 

One must ask in light of this and similar laws enacted across the 
country-why assessment? What do the various publics (including parents, 
legislators, departments of education, school boards, teachers) want to 
know? How can this information best be collected and disseminated? in 
answering these questions, one comes at once into contact with the con- 
cept of "cost of education"? leaders at the local and state levels are 
asking, "what am I getting for my educational dollar?" This question 
is now being posed by many people who feel that schools—as institutions 
which receive a significant piece of the local and state tax dollar- 
ought to be able to demonstrate their effectiveness. 

Effectiveness has different meanings fo;- different people. To the 
parent, it may mean the closeness of the personal relationships between 
a child and one teacher. Effectiveness to the teacher may mean the num- 
ber of students or class load with which he or she must, deal. To. the local 
school board or administrator, it may mean a better knowledge of "our" 
school in relationship to "others." To the state department of education, 
effectiveness may mean better decision-making opportunities for program 
improvement in public schools. Effectiveness to the state legislature 
may mean the data to answer constituents' questions about reading achieve- 
ment "back home." These and thousands of other perceptions of effective- 
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ness are part of the assessment movement's "reason for being." 

All of these different concerns call attention to the need for many, 
ways to collect and disseminate information to citizens. Perhaps the best 
way to meet the concern of the parent is for the board of education, ad- 
ministrators, and teachers to better communicate with all parents about 
the integrity of the seheol program, it may be that assessment and account- 
ability efforts are a manifestation of parents' loss of political and moral 
efficacy in their schools. 

The point is that there are many different questions, concerns, and 
perceptions relating to what we want to know about schools and schooling. 
Therefore, the assessment question is not one question, but many. It is 
important to understand today's pervasive models of assessment, particular- 
ly the narrowness or limitations of such models. These models are, for 
the most part, responsive to only a few questions, and they assess within 
a particular conceptual framework. 

At one conceptual level, the model most often employed in assessment 
efforts is the input-output analog of the factory. The assumption is that 
a qirect relationship exists between pupil achievement and specific instruc- 
tional efforts by the schools. The assumption is simple and pervasive. 
Assessment programs si.ould identify, via knowledge and skill test-',, chose 
schools with high and low pupil achievement. Then, by contrasting the 
characteristics of these schools, the teaching and curriculum factors re- 
sponsible for these significant variations can be determined. Given this 
informatioTx, educators can proceed to modify less effective schools. 

Despite their logical appeal, these .^sumptions and arguments ignore 
a rich fiejd of scholarship wkich supports a contrary conclusion. Stephens, 
in a review of educational research, discovered a constancy of sch )ol 
achievement regardless of instructional, curricular, or administrative 
variables.^ His compilation of studies indicates that variables such as 
independent study or regular classroom attendanco, program instruction 
or "regular" instruction, lecture or discussion, and heterogeneous or homo- 
geneous crouping, produce no significant difference in student achievement. 



2 

Stephens, J,. M. The Process of Schooling: A Psycholoc/ical Exaitdna- 
tion. New York: Hu±z, Rinehart and Winston, inc., 1,967. 



ERIC 



81 



This constancy of achievement results from what Stephens called the 
"spontaneous tendencies of human beings" and the "culture of the school." 

The term culture of the school refers to general environmental 
features, including the thought and actions of students. This "hidden 
curriculum" ordinarily teaches children as much or more than the intended 
curriculum of various subject matters. Philip Jackson found that through 
the use of praise and power in the classroom children are taught to be 
passive and acquiescent.^ 

Similarly, the culture of the classroom does much to determine child- 
ren's perception of learning and their investigation of problems.'* Two 
students, for example, may "know" the same fact or draw the same conclu- 
sion. However, if the first student was given the knowledge by a teach- 
er and the second arrived at his knowledge independently, the difference 
in cultural contexts is obvious. The first student, who repeatedly 
receives his knowledge from «n authority figure, is taught dependence on 
authority. Through repeated experiences in testing assumptions, the 
second student develops responsibility and initiative in dealing with 
ideas. 

At a second conceptual level, the model most often employed in 
assessment efforts is a derivative of the cost-benefit model used in 
market thec.y. This model suggests that a measurable relationship 
exists between the cost of education and the benefit** gained by both 
the individual and society. We have some idea of one side of the equa- 
tion— cost; now we must find out what lurks on the other side--benefits. 
It seems never to have occurred to ask whether or not the "processes" 
and "products" of education are measurable, or if this model, which 
functions as a decision-making facilitator, makes any sense at the levex 
of abstraction which deals with value or worth. 

The position taken hare is tl-at these two notions, or conceptual 
schemes, can, indeed, provide some information about schools that may 
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answer some of the previously stated questions. But we ought to be aware 
that this will be a limited set of questions.* Beyond this point, it 
should also be noted that perhaps even more important questions will not 
be considered—questions dealing with the rights of students involved in 
the assessment effort, the intellectual climate of the school, the inte- 
grity of the subject matter (are students involved in the craft of soc- 
ial studies?), the involvement of community people, and so on. 

In Wisconsin we tried to argue that the above questions are critical 
if assessment efforts are to truly provide the information for program 
improvement. But, like so many other things that "must be done," action 
was started despite'-the limitations of time, resources, and research in 
the area of assessment. This .-jsqueeze" between the fact of the law and 
the above-stated limitations should suggest a moral dilemma for all edu- 
cational leaders, simply stated, the dileitma is; we should be clear 
about the pervasive, and perhaps unconscious, confusion between what 
works and what is intellectually and morally right in any assessment at- 
tempt. The failure of many educators to deal with these issues before 
the fact of the law make manifest a reluctance to consider the moral and 
political nature of their actions. 



Assessment in Action 

Given the contextual limitations above, the social studies assess- 
ment effort in Wisconsin started with three basic purposes: (1) to iden- 
t^ify a selected group of objectives for social studies education; (2) to 
determine the degree to which students in Wisconsin are achieving these 
objectives; and (3) to provide information for decision making relative 
to program improvement. 

Before relating the sequence of the assessment process in Wisconsin, 
it may be important to say scaietthing about the relationship between the 



It may well be that a more useful picture of assessment will have to 
include models and/or conceptual frameworks from several discipline areas 
For example, a model from literary criticism can assess the classroom as * 

drama, complete with roles and lot. The integrity of the student's 
role could be assessed together with overall quality of the "play." Per- 
haps, an architectural model/structure can be employed also. Does the 
curricular and instructional pattern "look right" from a form and func- 
tion .point of view? These and many other conceptual viewpoints and 
questions will need to be considered before assessment truly comes of age 



ERIC 



I ui'0D091 



83 

Wisconsin Social Studies Curriculum Study Committee and the local school 
systems of the state. In the early 1960s the Department of Public In- 
struction established this Social Studies Committee to promote excellence 
in social studies education. The Social Studies Committee suggested a 
conceptual curriculum which has some en^)hasis on inquiry and various 
levels of thinking. The same conmittee irecommended attention to intel- 
lectual processes and values.^ 

Local districts have, for the most part, endorsed this approach to 
social studies. However, it should be pointed out that the state of 
Wisconsin has given power tlo local school systems to- establish curriculum 
objectives, with each of 400-plus districts setting social studies 
objectives, it is safe to say that, while there is a great deal of 
similarity among the several local social studies programs, there is 
also a great deal of variance. These local differences are also at- 
tributable to the fact that Wisconsin has no textbook adoption policy. 
We feel this flexibility within a larger conceptual framework is very 
conducive to excellence in social studies education. 

Having said this, it is also logical to assxime that social studies 
programs in Wisconsin represent a balance between the new and the tradi- 
tional. No test instrument cpuld ever f'-lly address the total social 
studies community. From the outset, people working with the state assess- 
ment effort were sensitive to this problem. This is why, as the asses^s • 
ment process developed, emphasis was placed cn the above three purposes 
which, in turn, placed emphasis on the overarching factors of conceptual 
learning and intellectual processes. This is not to say that specific 
content items were ignored or negated; as a matter of fact, that would 
have been impossible. However, it does point up the need for assessment 
at the state level to address the more common concerns of the several 
local social studies programs. 

In beginning work on assessment, the committee decided to relate 
its efforts to the Goals for Education report of the State Superinten- 
dent's Advisory Task Force on Educational Goals for Wisconsin's Elemen- 



^fefee A Conceptual Framework for the Social Studies and Knowledge 
Processes and Values in the New Social Studies. Madison, Wisconsin: Depart- 
ment of Public Instruction, n.d. 
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tary and Secondary Schools.'^ To facilitate this relationship and to delin- 
eate the objectives for the state assessment effort in the social studies, 
a state advisory committee was appointed by the state social studies speci- 
alist. This group of 21 people included some members from the state Social 
Studies Curriculum Study Comnittee and represented critical aspects and 
various groups within the social studies community. The main responsibility 
of this committee was to advise the Department of Public Instruction in 
making decisions on the directions of the total assessment process. Be- 
sides this advisory function, the committee also helped in the development 
of specific items on the assessment instrument and had the final say on 
the finished product. 

In studying the list of general educational goals, the coiranittee 
decided to ask all schools in the state to submit a list o^' their social 
studies objectives. This was done to see if there were ai'^y relationship 
between the general goal statement and the social studies objectives set 
by th- schools. The objectives from local schools were prioritized in 
terms of frequency. 

This process led to two conclusions. First, there seemed to be a 
great deal of congruence between the general goal statements and the objectives 
submitted^by^the^local schools. It was possible, for exairple, to place 
the list of state social studies objectives into categories that addressed 
the general goal statements. However, the committee felt that the schools' 
objectives were more specific bhan the goal statements, and it was de- 
cided to let the school social studies objectives determine the boundaries 
of the assessment effort. Second, it wcis decided to use only those objec- 
tives which showed up with some degree of frequency on the submitted lists. 
Using this method, 49 objectives were selected for the assessment process.^ 
In the judgment of the committee these 49 objectives best reflected the 
scope and intensity of the assessment effort. 

After the initial objective selection effort, the committee divided 
the objective list into three categories consistent with the Department 



7 

Goals for Education. Madison, Wisconsin: Department of Public 
Instruction, December 1972. 

Q 

Social Studies Objectives. Madison, Wisconsin: state Advisory 
Conmittee, Department of Public Instruction, 1974. 
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of Public Instruction's instructional guide entitled Kn<x/ledge, Processes 
and values in the New Social Studies.^ This booklet provides social 
studies educators with guidelines for including the knowledge, cognitive 
processes and skills, and affective considerations necessary in any 
sociaUL studies program. 

Subcommittees were then formed to prepare test items for objectives 
in each category* knowledge, processes/skills, and values. Obviously, 
there was a great deal of overlap in the items developed; nevertheless, 
this division did provide a focus that facilitated the total developmental 
effort, and these subcommittees were able to generate test items appro- . 
priate to the 49 objectives. The items from the three subcommittt ,s 
were then field tested and synthesized into assessment instruments for 
the fourth and eighth grades. 

The next step in the assessment process will be the administration 
of the test instrument in a random sample of schools throughout the state. 
Twenty students will be randomly selected from classes in each of the 
selected schools. The final state sample will consist of approximately 
4000 fourth-grade students and approximately 6000 eighth-grade students.- 
This entire sample will be given a battery of written items appropriate 
to their levels and involving the three components of knowledge, pro- 
cesses, and values. It is probable that, to reduce the time involvement 
of individual students, no single student will respond to all the items. 
This may be done since no effort will be made to establish scores for 
individuals . 

On this point, it is important to realize that the overall purpose 
of the assessment is to provide j- formation, not to make judgments 
about the responsibility of persons or conditions involved in teaching 
.«?c jial studies. No school district, teacher, or student will be iden- 
tified in the sample and, therefore, no one will be subject to criticism 
based on the assessment. Rather, persons making judgments about future 
changes in social studies programs will use the assessment data to evalu- 
ate what students at selected grade levels in the public schools know, 
•low they thinks' and how they feel about social studies, in this way. 



9 

Knowledge, Processes and Values in the New Social Studies, 
Madison, Wisconsin: Bulletin #185, Wisconsin Department of Public 
Instruction, 1970. 
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the Wisconsin social studies assessment will provide an educational census 
which can assist educators in developing social studies education programs 
of the highest possible quality. 

The census data can be used in many different ways by the various 
publics concerned with social studies education. For example, at the state 
level, the legislature will benefit from the profiles of student achieve- 
ment in social studies provided by tl ^ data; this information should be 
of value in making decisions about Wisconsin education. 

The Department of Public Instruction will make use of the assessment 
data in providing improved services ai^d leadership to local school districts, 
universities, and regional educational offices. The extent to which stu- 
dents are or are not achieving specified objectives will provide the De- 
partment of Public Instruction with data for recommending program develop- 
ment and modification. 

The university system and private colleges of the state will have 
the data available for study and review of the teacher preparation pro- 
cesses at the several campuses, with such data these programs, vas well 
as the many inservice and graduate programs run by the universities and 
colleges, can more intelligently meet the needs of teachers in the state 
and, in turn, the needs of the students. 

At the regional level, the results of the study will be of direct 
interest to the Cooperative Educational Service Agencies (CESAs) . It is 
through the CESAs that many districts organize and conduct inservice pro- 
grams. The assessment will provide a basis for determining the need for 
and nature. of these inservice programs. In addition, the study will be 
useful in pointing-out the need for additional resources or consultative 
personnel v;ithin a region. In some regions, consortia of colleges and 
universities are emerging. Ag^-Jn> the results of the study will be of 
direct benefit to the members of these consortia as they plan their pro- 
grams and pool their resources to meet educational needs more effectively 
and efficiently. 

At the local level, the district and building personnel will have 
the results available to them as they make program decisions on curriculum 
and instruction. Although the data will not specifically relate to the 
district, local educators will still be able to conduct their own study 
of achievement among local students by using the objectives established 
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for the assessment and comparing the results of their studies with the 
state results, in thi.s way, che district is encouraged to develop and 
control its own systematic assessment program. The state- assessment 
provides the model, the direction, and the basis for comparison, but 
the control for local assessment is left in the hands of the local 
board. 

At the individual level, the statewide results will be of direct 
interest to parents and teachers, both in their concern for the well- 
being of their children and students and in their role as taxpayers. 

Again it should be pointed out that although the information gath- 
ered on the assessment should provide information as delineated above, 
this kind of assessment procedure is in no way complete. The assess- 
ment will tell us certain things related to specific objectives, but 
it will in no way be inclusive. The model upon which it is built can 
only reveal so much about a social situation like the school. 

It should be clear, then, from the above discussion, that the fac- 
tory analog and the cost-benefit model discussed earlier constitute the 
conceptual framework for social studies assessment in Wisconsin. We 
are, however, questioning this framework while at the same time trying 
to meet the letter and spirit of the law. We realize that the informa- 
tion gathered by this initial effort will be incomplete. It may even 
place emphasis on the most insignificant data. For example, since we 
know that student achievement in school is basically a function of I.Q. 
and social-economic background, it may make a great deal more sense to 
focus assessment efforts on the "culture of the School," the integrity 
of the learning situation within the social studies classroom, or the 
integrity and honesty with which teachers and students approach the 
craft of s^^ial study. 

Perhaps, the dilemma that social studies educators face today, par- 
ticularly at the state level, is a manifestation of the relinquishing 
of ethical (educational) decisions to political (interest groups) ex- 
pediencies. It should be clear from the above discussion that it is 
possible to establish a logical assessment program based upon a parti- 
cular conceptual framework or prior question. The dilemma begins when 
prior questions and conceptual frameworks must be related to their 
ethical underpinnings. Until these prior questions are probed by a 
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larger audience in the social studies coxtmunity, assessment will remain 
simply a technique. We should always be aware that to err in questions 
of etliics always leads to .a loss of privilege. It may well be that the 
fall from privilege is facilitated by technique devoid of ethical consid- 
erations • 
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ANNOTATED LIST OF SELECTED DOCUMENTS FROM 



STATE DEPARTMENTS OF EDUCATION 



ALASKA 

Educational Needs of Alaska: A Summary by Region and by Ethnic Group, 
1972-73 . Juneau: Worldwide Education and Research Institute, 
1973, 91 pp* 

This publication reports on a^.statewide needs assessment in Alaska 
done by Worldwide Education and' Research Institute* Based on 
interviews and questionnaires canpleted by some 2,000 Alaskans, 
the report pinpoints needs of target groups, specifying the level 
of criticality for each group. A further breakdown of needs is 
given for four population areas. 

ARIZONA 

Educational Needs Assessment Program for Arizona* Phoenix: Arizona 
Department of Education, n.d. 148 pp. 

A report on the secpnd phaser^of Arizona's effort to develop a 
statewide system for assessing student achievement. The publi- 
cation identifies student achievement at the completion of 
elementary school experience in the basic subject areas of reading, 
arithmetic, and writing; the achievement information is based 
on an extensive testing program. Introductory material provides 
an explanation of the Eduuationcd Needs Assessment Program for 
Arizona (ENAPA) . Report includes tables, figures, and a needs 
assessment model. 

CALIFORNIA 

Education for the People; Guidelines for itotal Community Pai >k 
in Forming and Strengthening the Future of Public Elementary .la 
Secondary Education in California / Volume I. Sacramento: 
California State Legislature Joint Coiranittee on Educational 
Goals and Evaluation and California State Department of Education, 
1972. 36 pp. 

A publication designed to outline the long-range plan for improved 
education in California. A process for developing goals and 
objectives is explained and illustrated with a model for imple- 
menting the process. The publication is directed to local 
school personnel and citizens to help them develop and implement 
their own assessement and evaluation programs, 

CQLORADO 

"Educational Accountability in Colorado." Denver: Colorado Depart- 
ment of Education, 1972. 3 pp. 

This public information brochure gives the background and general 
plan for an educational accountability program in Colorado. 
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"Eaucational Goals for Colorado Citizens." Denver: Colorado Depart- 
ment of Education, 1372. 1 pp* 

A public information brochure which outlines the general goals 
and performance objeci:ives set forth for public school education. 
Goals are based on board of education suggestions, citizen state- 
mants and research. 

CONNECTICUT 

Connecticut Citizens Response to Educational Goals 1971 -7 2 > Hartford : 
Connecticut State Board^of Education, n*d* 49 pp. 

This report summarizes the results of a study made to determine 
public response to proposed goals for Connecticut education. 
Nearly 10,000 Connecticut citizens responded to a question- 
naire; from their responses the study group defined six broad 
goals with sypporting sub-goals to be used as guidelines for 
state educationed. programs. 

DELAWARE 

Goal Statements for Delav/are Public School Students for the 70 's and 

QQ's * Dover: Delaware Department of Public Instruction, Planning, 
Research and Evaluation Division, 1972. 11 pp. 

This document addressed to the people of Delaware spells out 
the nine goals adopted by the state's Department of Public 
Instruction to guide the state's education system. 

"Social Studies Objectives." Dover: State Department of Education, 
n*d* Mimeographed, pages vary for each grade level. 

In loose-leaf, mimeographed form, these documents outline the 
social studies performance objectives students are expected to 
accomplish at each grade level. To be used by teachers and 
administrators on a voluntary basis to evaluate their own programs. 

Systematic, Comprehensive, Long-Range Plan to Biiprove Education in 
the Delaware Public Elementcury and Secondary Schools . Dover: 
Department of Public Instruction, Research and Accountability, 
1972. 36 pp. 

Based on a comprehensive planning and evaluation model, this 
publication details the long-range plan developed in Delaware 
for improving public school education. The Plan begins with the 
defining of broad goals and concludes with specifying means for 
implementing programs to meet goals. 

FLORIDA 

Goals for Education in Florida . Tallahassee: Department of Education, 
n.d. 11 pp. ^ 

In this publication directed to the citizens of Florida, the 
state Department of Education presents its rationale for defining 
educatio2ial goals and lists ten goal areas for the state's 
educational system. 
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IDAHO 

"Philosophy of the Idaho Department of Education." Boise: State of 
Idaho, Department of Education, n.d. Mimeographed, 8 pp. 

Oliis publication presents the broad "guiding principles" for the 
conduct of public education in Idaho. The document is designed 
to inform the general piablic of the state Department's philosophy 
of education and to encourage local schools to formulate their 
own philosophies. 

INDIANA 

PPBS (Planning, Programming, Budgeting System) and Indiana Schools; A 
Manual for Operationalizing PPBS . Indianapolis: Indiana State 
Department of Public Instruction, Division of Planning and 
Evaluation, 1973. 86 pp. 

Directed to Indiana educators, this manual broadly outlines how 
the Department of Public instruction plans to implement the 
planning, programming, and budgeting system mandated by the 
Public Assembly. Procedures for determining needs, goals, 
objectives, program planning, evaluation data collection and 
bud'-iting are defined. 

KANSAS 

"Accountability Chart." Topeka: Kansas State Department of Education, 

Planning, Resefiorch and Evaliaation Section, 1973. Mimeographed, 1 pp* 

A one -page chart depicting who is accountable to whom and for 
what in Kansas public education. 

Matericils Beincj Used in District -v?ide Accreditation/Evaluation Procedures . 
Topeka: ICansas Stcite Department of Education, Planning, Research 
and Evaluation Section and Accreditation Section, 1973. 46 pp. 

A booklet designed to assist local education agencies who are 
contemplating systematized educatio^ial program planning. Gives 
suggested procedxires for setting up c ^al assessment programs 
and performance objective systems. Includes a model for edu- 
cational program planning cind management. 

State-wide Goals for Education in Kansas . Topeka: Kansas State Board 
of Education, 1972. 23 pp. 

Based on the thinking of Kansas educators and citizens, this ptab- 
lication defines four major goals for public education and details 
sub-goals and objectives for reaching these goals. Includes time- 
tables for goal attainment. 

KENTUCKY 

Goals of Education in Kentucky .' Frankfort: Kentucky State Board of 
Education, 1973. 12 pp. 

This publication, designed for the general public, states the gen- 
eral philosophy and eight broad educational goals for public school 
education in the state of Kentucky. 
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S^«°S2"st:S^r:a^a?° °' '^"'-"'•^ wan to 

ana rfnirero^'^L-S^/Jo^ ^ Sal!^" ^ ~ . 

Kentucky Educational Wpa>^» aoo^..^pn^. gtudv Ph;i«« tt t 

'^-•^nlrfnrf -Lain . r ■_. . . ^^'"^V^ ^"'^se II. Lea rner Needs . 
104 pp Kentucky Department ot Education, 1971. 

In the second phase of Kentuckv**? niar, .c„^ „ , 
performance qoa3s an^ «v,^2^ • "^eds assessment, 

*^ w^iuonce goais and objectives based on the data f-mm dv, = „« x 
were developed and field tested n=,Z= ^^^^f^^ Phase I 

the ^iSrS; S tie sJuay '^^ ^-'-"^ 

! ^tnc.y Eaucationa, ^^^as ^a,.e. „ 

1 972. 266 pp" Kentucky state Department of Eaucation, 

irTZlt ! "^'"J-'s Of a continuation of Phase II are reported 
in this phase children in 41 additional school aisSictfiS' 
tested in reading, math, and psychomotor skills 

KentuckyEducationa, Pro-am ^ rts for Cr.d,, . » ... „ 

18/ pp., Grade 8 - 201 pp.. Grade 11 - 191 pp. 
Based on the assessment data collected in Phases t-ttt ^v, 

^rSr^opS^jSitrtni.-:^-^^^^^^ 

and statewide bases. results on district, regional. 



LOUISIANA 

Louisiana Assessment of Kr^n^^^,-»^o-i Prooress Ba^«n n . • 

S tate Department ot Education, 19^ T pp°''°" 

project, coals and general i^'pU^^nLL^n'Sa" 
""""-S^^^^^^^^ -on Houge: Louisiana state Oepirt- 

«ia citizens, this document outlines a "framework 
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for a vitalization of education and training from kindergarten 

through postsecondary education". Included is a description of 

the philosophy and direction of Louisana's needs assessment program* 

MAINE 

"Maine Assessment of Educational Progress/' Augusta: Department of 

Educational and Cultural Services, Maine Assessment of Educational 
Progress, n.d* 6 pp. 

General public information brochure which explains the general 
purpose of the Maine Assessnvent of Educational Progress and gives 
highlights of the first phase of the program, statewide testing 
in the areas of citizenship and writing. 

Maine Assessment of Edacat l onal Progress; Reports 2-6 (five volumes) . 
Augusta: Department of Educational and Cultural Services, 1972. 
Number of pages varies with volume. 

This set of publications describes in detail the first phase of 
Maine's ten-yeea: assessment program. The first phase, completed 
in 1972, involved statewide testing of randomly selected 17- 
year-old students in the areas of citizenship and writing. The 
reports detail the testing procedxires and give a breakdown of the 
results of the testing. Ihe results are summarized in a short 
brochure also entitled "Maine Assessment of Educational Progress." 

School Self-Evaluation Manual . Augusta: Department of Educational and 
Cultural Services, 1973. 160 pp. 

Developed by professionals in the Maine Department of Education, 
this manual is designed for use by local elementary school committees, 
composed of school staff and citizens, who are evaluating their 
school progreuas. The manual will help schools determine strengths 
and weaknesses in all aspects of the total school program and to 
determine short- and long-range goals. 

MARYLAND 

"Design for Accountability: A prelimineiry Report." 

"A Plan to Implement the Maryland Educational Accountability Law." 

"Statewide Goals in Reading, Writing and Mathematics." Annapolis: 

Reports from the Advisory Council on Accountability to the Mary- 
land State Board of Education, n.d. Mimeographed, number of 
pages varies. 

These three reports from Maryland's Advisory Council on Account- 
ability, appointed by the State Superintendent of Education, 
outline the Council's general philosophy of accountability, a 
plan for implementing the Maryland Educational Accountability 
Law, and broad, statewide goals for the areas of reading, writing, 
and math. 



MASSACHUSETTS 

Educational Goals for Massachusetts . Boston: The Commonwealth of 
Massachusetts, Board of Education, 1971. 20 pp. 
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Sicat^i and °' ^ nine-month study by professional 

educators and citizens to delineate broad educational goals for 
elementary and secondary education in the -state. The reoort 
cites ten "broad but flexible educational aims" for the 'next 
IT/tV ""'^"^Pt^ conditions necessary to meet the aims, 
and the steps required to meet the aims. 

MICHIGAN 

"rKd-ucTtL^n'ist:";; iTr''^^- 

Sirwf"^*'^"" f^^*"^"^ ""^^ g^^eral direction of 

rars:Ttrn?s?Vnd^Si^^^^ — - 

'-'^^r^^r;^ -nsing: Michigan 

Hie stated purpose of this publication is to "place in proper 
perspective the role of the State Board of Education in SplLnt- 

llLTi r^'T"^^'''^ "^""^ ^^^--^ delivery ofed^" 
Iv^t M?7!°^'-l " accountability model developed 

by the M^^higan Department of Education staff and a general 

tSi^rJysJe^! accountability win be built into the educa- 

"c^-^^ f!"f Performance Objectives, Elementary Level." 

n Objectives, Secondary Level." Lansing: 

Svp^^*So^^"*^ f Education, 1973. Mimeographed, elementary 
±evel— 99 pp., secondary level— 114 pp. 

thr^^?^^ H educators and social studies specialists in 

the state of Michigan, these two booklets outline social studies 
obDectives for elementary and secondary levels. The objectives 
are based on the common goals set forth for Michigan education. 
Ob3ectives are described in terms of general topics, specific 
performance skills, and examples for classroom use. 



MINNESOTA 
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"Accountability in Social Studies Through Assessment: Minnesota's 

TSf M^^' u ^^"^^ Minnesota Department of Education, 
1973. Mimeographed, 33 pp. 

teacher::, this' publication outlines 
the bcaad direction accountability in social studies will take in 
Minnesota and defines the objectives that will be used in Se 

of Lcifl «ere developed by a task force 

of social studies educators from the state of Minnesota. 

Minnesota Educational Assessment: A C omprehensive Plann.'n. ^.„.y 
St. Paul: Minnesota Department of Education, 1973". — 97 pp. 

asi llTr^t ofT'^"' ^--essment plan proposed for Minnesota 
as a result of a planning study by the Research Triangle Institute 
Described is a plan for statewide testing to assess needs 
various areas. The report deals in detail with proposals for 
management and staffing, instrument development, "sa^lS/^ta 
collection, analysis, and dissemination of results. 
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A Self-Assessiaent Inventory for Social Studies to Accx^mpany the National 
Council for Social Studies CurricxlLum Guidelines > St. Paul: 
Revised and Distributed in Minnesota by the State Department of 
Education, 1973. 39 pp. 

A self -assessment instrxanent which accompanies the National Council for 
the Spcial Studies Guidelines for new directions in social studies. 
The original Guidelines have been revised and adapted to Minne- 
sota's needs and directions. To be used by local social studies 
curricxilum revision committees. 

MISSISSIPPI 

General Educational Needs Assessment s Jackson: State Depart&ent of Edu- 
cation, Council for Planning and Evaluation, 1972. 150 pp. 

A report on Mississippi's first step, general educational needs 
assessment, in a comprehensive planning program. Under the 
direction of a Council for Planning and Evaluation, a statewide 
questionnaire survey of educators and citizens was completed. 
Ttxe instrument used and the results of the survey are included. 

Goals for Public Elementary and Secondary Education in Mississippi . 
Jackson: Mississippi State Department of Education: Office of 
Planning and Evaluation, 1973. 94 pp. 

Based on the genered. needs assessment study conducted in 1972, 
this publication details the next phase of Mississippi comprehensive 
planning program, the development of goal statements and their 
order of priority. Needs assessment was conducted by mailing 
opinionnaires to administrators and randomly selected citizens 
throughout the state. The document includes the instrument and 
resxilts of the survey. 

MISSOURI 

Educational Goals for the State of Missouri . Jefferson City: Missouri 
State Dep2u:tment of Education, 1972. 10 pp. 

Written by the State Department of Education staff, this publication 
defines the four broad goals of education for the state. The 
goals concern intellecuuaJL, physical, social, and career 
development. An eight-phase plan for statewide assessment is 
broadly spelled out. 

Educationa Objectives for the State of Missouri . Jefferson City: 
Missouri State Department of Education, 1973. 76 pp. 

With contributions by 7,000 citizens of Missouri, including 
professionals and lay persons, this publication defines the 
specific objectives needed to reach the broad goals defined for 
Missouri education. Each objective is followed by a short 
performance indicator and a paragraph describing the specific 
types of behavior that could be expected of students at certain 
grade levels. The publication was written "to assist the local 
school district in establishing or reviewing educational objec- 
tives for instruction within the local school district." 
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NEBRASKA 



Nebraska state Assessm ent; First Report . Lincoln: "Nebraska Dc^part- 
ment of Education: Planning, Evaluation and Research, 197-'' 
69 pp. 

The report begins with an enumeration of the educational goals 
determined by the Nebraska Department of Education staff and 
Nebraska citizens. The report then describes an extensive 
statewide testing program conducted to (1) profile a picture of 
educational needs and successes and (2) provide more flexible, 
realistic tests for Nebraska educators. The actual tests used 
(m reading and math only) are included, along with a summary of 
student performance in each skill area. 

A Philosophy for the T eaching of the Social Studies . Lincoln: 
Nebraska state Departtont of Education, 1971~ 34 pp. 

Written by a panel of social studies educators, this publication 
sets forth a philosophy for teaching social studies which includes 
both general goals and the specific student behaviors necessary 
to meet the goals. 



NEVADA 



Common Goa ls of Nevada Education . Carson City: Nevada Department of 
Education, Planning and Evaluation Division, 1971. 16 pp. 

This publication, aimed at the general public, outlines ten 
general goals for Nevada public education. The goals are grouped 
into three areas . 

Comprehens ive iPlanning Model for Educational Programs . Carson City: 
Nevada State Department of Education, Division of Planning and 
Evaluation, 1973. 19 pp. 

This document provides information about planning and evaluation 
within the Nevada Department of Education. It presents a 
comprehensive planning model which can be used in educational 
planning at any level of operation. The model provides seven 
basic steps for problem solving beginning with goal formulation 
and continuing through continuous evaluation. 

"Guidelines for Goal and Objective Development." 

"Guidelines and Procedures for Updating Process Objectives." Carson 
City: Nevada Department of Education, Division of Planning and 
Evaluation, 1971. Mimeographed, pages vary. 

Th.ese two companion documents are aimed at administrators. 
"Guidelines for Goal and Objective Development" explains how to 
develop goals and how to use the goals to develop performance 
objectives (learner) and process objectives (administrative) . 
The second document • "Guidelines and Procedures for Updating Process 
ObDectives," explains procedures and methods for evaluating and 
updating process objectives. 

Nevada 1971-1972 Need s Assessment; Cognitive Pretest •- Posttest Com- 
parisons, Affectiv e Presurvey - Postf.urvey Ccttparisons. rarg^n 
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City: Nevada Department of Education, Division of Planning and 
Evaluation, 1972. 35 pp. 

This is a report and data summary of the 1971-72 Needs Assessment 
Program conducted by the Nevada Department of Education. Based 
on performance objectives written by classroom teachers, third- 
grade students from the entire state were pre- and posttested in 
the areas of reading, math, and self-concept. 

NEW JERSEY 

Highlights of a Survey on Educational Goals Conducted for New Jersey 
Departmen t of Education . Trenton: Opinion Research Corporation 
for the New Jersey Department of Education, 1972. 7 pp. 

A report of the" results of an interview study conducted with a 
sample of over 1,000 New Jersey residents to determine their 
views on the status and needs of public education in the state. 

"Our Schools." Trenton: New Jersey Department of Education, Division 
of Research, Planning and Evaluation, lS/2-73. 3 pp. 

A general information brochure which briefly describes the 
formation of the Needs Assessment Advisory Council and defines the 
outcome goals and process goals set forth by the Council . 

A Summary of the "Our Schools" Project, 1970-1972 > Trenton: New 

Jersey Department of Education, Division of Research, Planning arid 
Evaluation, 1972. 41 pp. 

In 1970 the State Board of Education set in motion the New Jersey 
Needs Assessment Project known as "Our Schools" by forming an 
Advisory Council . In the next two years the Advisory Coxincil 
solicited opinions on public education from lay citizens and 
professional educators. This report summarizes the Council's 
findings, sets forth the general outcome and process goals 
determined by the Council, and gives their recommendations for 
further steps in the assessment project. 

Utilizi ng Assessment Information in Educational Planning and Decision 
Making.* Trenton: New Jersey State Department of Education, 
Division of Research, Planning and Evaluation, 1973. 17 pp» 

This is a summary report of the initial statewide testing program 
conducted in New Jersey in 1972. The testing program involved 
fourth- and fifth-grade students who were tested for achievement 
in the basic skill areas of reading and math. The development 
of testing instruments from responses of classroom teachers is 
described. Results of student, testing are discussed by district. 

NEW MEXICO 

A Manual To Aid the Understanding and Implementation of the Statewide 
Evaluation Program . Sant^i Fe: New Mexico state Department of 
Education, Evaluation and Assessment Unit, 1973-74. '14 pp. 

This publication is directed toward local administrators and is 
designed to help them \inderstand and implement the objective- 
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n!Sl^''^i"^!^°" ^^^''5 developed by Mew Mexico State 

Department of Education, 'ihe program calls for each district 

S^ranS^^f ^f"* Previously formulated "objective banks" 
and to rank them according to local priorities. The report aives 
suggestions for local implementation and use of selected objecSJes 

sSJr,^ ^T^""^^ An Introduction." Santa re- 

state Department of Education, Evaluation Unit, 1973-74 
1 pp. ' ^* 

LTTJ.^ infonnation brochure giving a brief introduction to 
the statewide evaluation program. The publication describes the 
testing program which has been in effect since 1966 and the 
objective-based evaluation program begun in 1972 to measure 
priority objectives selected by each district. 

- ^ ■ ""l^^J^^^ CoaniMv e Skill Areas . Santa Fe: New Mexico 

State Department of Education, Evaluation, Assessment an^ 
Testing Unit, 1973-74. 22 pp. ^-neni: ana 

P'««e"ts the objectives in the New Mexico State 
Department of Education's 1973-74 Objective Bank. Included Se 

TallTr lT ^l"^"^' "'"^^i^^tion, science, social studies, and 
career education. 

'""^'Me^L' s^^' O^-^ecti ve-Rase d^ . Santa Fe: New 

To enable local educators to assess their students' ability to 
meet the locally determined objectives, the New Mexico State 
Department of Education is constructing test items to measure 
the basic cognitive skills. This booklet contains sample test 
Items for each of the 40 tests currently being used statewide. 

NORTH CAROLINA 

"Developing Accountability in Theory and Practice." Raleigh- state 
Department of Public Instruction, Division of Research, n d 
Mimeographed, 52 pp. ' 

In loose-leaf form, this document discusses the theory of account- 
ability and reviews some current accountability practices in 
other states. The paper was written to aid in the development 
or an accountability program in North Carolina. 

Handbook for Planning i n the l ocal School System . Raleigh: Department 

slZT Division of Plaining/Administrative 

services, 1972. 31 pp. 

ov^^Lij^nf '7 administrators to heip them in 

disSicts improvement of educational services in their 

State Assessment of Educational Progress in Nbrth r.^v...... j^i^igh: 

S'S!"' Instruction, Division of Research/ 

This report summarizes the first step of North Carolina's 
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Statewide Assessment of Student Educatioxuil Status. In this 
phase a representative sample of sixth gradeirs was tested in 
several learning areas. The results of the testing are analyzed 
by subject area and by regional considerations. 

OHIO 

What 125,000 Ohioans Want From Their Schools; Alternatives for Edu- 
cational Redesign . Columbus: Ohio Department of Education, 
1973. 31 pp. 

In 1973 over 125,000 Ohio citizens participated in a series of 
group conferences to discuss alternative ways of redesigning 
the state's educational system. This report summarizes the 
opinions expressed in those discxissions. 

OKLAHOMA 

Needs Assessment . 0}clahOBia City: Oklahoma State Department of 
Education^ n.d. 39 pp. 

The Oklahoma State Department of Education considers a needs 
assessment progreim as one phase of an accounteibility system. 
This report is designed to help local school districts which 
will carry out their own needs assessTiient. Included is an 
overfill plan for setting up a needs assessment and some specific 
suggestions for implementation. 

PENNSYLVANIA 

Educational Quality Assessment; The Pennsylvania Plan (section IX. 
Harrisburg: Pennsylvania Department of Education, Office of 
Resezurch and Statistics^ 1970. 6 pp. 

This boo3clet gives a broad view of the Pennsylvania plan for 
Educational Quality Assessment. The program, began in 1965, 
has involved the definition of ten educational goals, the 
development of measuring instrvmvents, testing of representative 
sample populations, emalyzing data^ and incorporating the 
findings into useful working tools . 

Educational Quality Assessment: Phase II Findings (section two, 

five, six). Hearrisburg: Pennsylvania Department of Education, 
Bxareau of Educational Quality Assessment^ 1970. Section 2-21 pp., 
section 5 - 30 pp., section 6 - 39 pp. 

These reports give considerable detail concerning the procedures 
and analyses used in the testing program conducted as part of 
Pennsylvania's Educational Quality Assessment Program. Section 
two concerns procedures; section five deals with the definition and 
measurement of pupil/ school, and comntunity conditions; section 
six gives a techniced analysis of the data collected. 

EQA Inventory Technical Manual (Grades 7 and 9)!. Harrisburg: Pennsyl- 
vania Department of Education, Division of Educational Quality 
Assessment, 1973. 83 pp. 

A techniced manual giving details of the development and use^ 
of testing procedures in the Pennsylvania Educational Quality 
Assessment Program. 
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Manuals fo r Interpret inc? Intermediate School Reports (Grade 7 and Grade 9) 
Harrisburg; Pennsylvania Department of Education, Division 
of Educational Quality Assessment, 1973. Grade 7 - 69 pp 
Grade 9 - 71 pp. 

These manuals are designed to help school administrators and 
teachers interpret the findings of the assessment reports 
produced by the testing procedures used in Pennsylvania. 

SOUTH CAROLINA 

"Accountability: State and District Involvement." Columbia: South 
Carolina Department of Education, n.d. Mimeographed, 7 pp. 

This loose-leaf document presents the general plan for account- 
ability in South Carolina. It focuses on tiie 11 objectives set 
for state education and the timetable defined for meeting the 
objectives on a local basis. 

Objectiv es for South Carolina Piablic Schools: A Five Year Plan 

(seven docnaaents). Columbia: South Carolina Department o£ Edu~ 
cation, n.d. 

1. Reduce the Number of First Grade Failures in the South 
Carolina Public Schools." 22 pp. 

2. "To Assess Annually the Educational Quality in Each School 
District in South Carolina." 16 pp. 

3. "To Implement a State System of Kindergarten Education in the 
South Carolina Public Schools." 19 pp. 

4. "To Reduce the Number of Dropouts in the South Carolina 
Public Schools." 22 pp. 

5. "To Increase the Enrollment of South Carolina Adults in 
Basic and High School Programs." 21 pp. 

6. "To Increase the Number of South Carolina High School Graduates 
Entering Post High School.Education Programs." 23 pp. 

7 . "To Implement a Defined Minimiam Program in Each School 
District." 58 pp. 

In 1970 the State Department of Education in South Carolina 
adopted 11 objectives to be accomplished in a five-year plan. 
Each booklet in this series focuses on one of those objectives 
and gives specific suggestions and information to be used in 
meeting the objectives. 

SOUTH DAKOTA 

"A Public Involvement Plan for South Dakota School Districts." Pierre: 
Department of Public Instruction, n.d. 8 pp. 

A publication aimed at local citizens and administrators to aid 
them in setting up local task forces to evaluate schools. 
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Questionnaire—To Determine Educational Needs As You See Them, Pierre: 
South Dakota Department of Public Instruction, n.d. 20 pp. 

A questionnaire booklet sent to administrators in South Dakota 
to i:elp the Department of Public Instruction assess educational 
needs • 

"Success Is a Journey. . .Not a Destination!" Pierre: South Dakota 
Department of Public Instruction, n.d. 18 pp, 

A public information pamphlet which provides a general introduc- 
tion to the concept of educational accountability and stresses 
the importcmce of management by objectives. 

TEXAS 

Educational Needs Assessment; A statewide Design for Texas , Austin; ' 
Texas Education Agency, Division of Program Planning and Needs 
Assessment, 1972. 34 pp. 

This document presents a "position statement on educational 

needs assessment" for the state of Texas. Included are the 

general goals for public education and a general framework for 

assessing areas in which those goals are not being met. The 

needs assessments are to be the basis of state-wide educational 
planning. 

"Goals for Public School Eflucation in Texas," Austin: Texas Educa- 
tion Agency, 1973. i pp. 

A public information publication stating the broad goals for 
Texas public school education that were adopted by the Texas 
Educatio' Agennqr. 

A Needs Assessment Report; Sixth Grade Reading . 

A Needs Assessment Report: sixth Grade Mathematics . Austin: Texas 
Education Agency, Division of Program Planning and Needs Assess- 
ment, 1972. ' Reading— 88 pp., math— 119 pp. 

These two reports detail the statewide testing programs conducted 
with sample populations of sixth graders as part of the overall 
needs assessment plan for Texas. Findings of the testing program 
are summarized and possible uses of the information are suggested. 

VIRGINIA 

I^nual for Implementing standards of Quality and Objectives for Public 

Schools in Virginia, 1972-74. Richmond: Virginia State Department of 
Education, 1972. 139 pp. 

A manual directed toward local administrators which gives sugges- 
tions and instructions for implementing the standards and objec- 
tives specified by the Virginia General Assembly. Included is 
information on standards for personnel, programs, performance, 
and management in all phases of education. 



ERLC 



117 



WASHINGTON 

"Consensus Formation on Educational Outcomes Using a Modified Delphi 
Technique." Olympia: Washington Superintendent of Public 
Instruction, 1971. Mimeographed, 29 pp. 

This report describes the process which Washington used in 
determining educational goals for the Washington common schools. 
Using a modified Delphi technique, nearly 900 persons from around 
the state were asked to respond to three sequential individual 
questionnaires. From' these responses the goals were defined. 

"What Are Schools For?" 01yn\pia: Washington Superintendent of Public 
Instruction, n.d. 1 pp. 

This brochure is designed as a public information document to 
delineate the broad educational goals defined by a statewide 
survey of professional educators • and lay citizens' opinions on 
public education. 

The World We Live In. Olympia: Washington Superintendent of Public 
Instruction, n.d. 72 pp. 

Directed toward shhool personnel in leadership positions, this 
document deals with the problems related to the overall planning 
of social studies programs in public schools. Not intended 
to be immediately applicable to classroom use. 

WEST VIRGINIA 

"West Virginia Educational Assessment Plan." Charleston: Ifest 

Virginia Department of Education, Bureau of Planning, Research 
and Evaluation, 1973. Mimeographed, 7 pp. 

An outline of the statewide assessment program which will be 
instituted in west Virginia. Included is a model detailing the 
sequence and timatablfe that will be followed in the program. 

WISCONSIN 

Educational Goals. Madison: Wisconsin Department of Public instruc- 
tion, 1972. 25 pp. 

Taken from the final report of the Advisory Task Force on 
Educational Goals, this publication enumerates the broad edu- 
cational goals developed by the Task Force from an extensive 
citizen survey. 

Wisconsin Assessment Program. Madison: Wisconsin Department of 
Public Instruction, n.d. 6 pp. 

This general information pamphlet is designed to -ive ; the public 
a look at the broad plan and objectives for educational assess- 
ment m Wisconsin. 

WYOMING 

The Revised Accredita tion-Evaluation Process for Wyoming Public 
Schools. Cheyenne: Wyoming state Department of Education. 
1973. 31 pp. 
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Directed toward local administrators, this document focuses on 
the rationale and meanings of a revision of accreditation stan- 
dards for Wyoming public schools. Included is also a planning 
model for use in the development of instructional programs. 

WYBNAP Progress Report, Volume I; Goals and Objectives . Laramie: 

Center for Research, Service and Publication, College of Educa- 
tion, University of Wyoming, 1973. 340 pp. 

The Wyoming Educational Needs Assest-ment Project (WYENAP) was 
initiated in 1971 by the Wyoming State Department of Education 
under contract with the University of Wyoming's Center for 
Research, Service, and Publication in the College of Education. 
Volume I represents "the first comprehensive list of goals and 
objectives ever developed for Wyoming elementary and secondary 
education," and is broken down into specific curricular areas. 

WYENAP Progress Report, Volume li; Perspectives . Laramie: Center for 
Research, Service and Publication, College of Education, 
University of Wyoming, 1973. 136 pp. 

Volume II of the WYENAP report contains a series of articles 
designed to e:q?lain the goals and objectives as they are related 
to elementary education, secondary education, public school 
finance, school district reorganization, and the demography 
- of Wyoming. 
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